-- Logs begin at Wed 2022-06-22 08:03:45 UTC, end at Wed 2022-06-22 09:30:19 UTC. -- Jun 22 08:58:31.389281 dv-cinder-803823-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 08:58:31.397885 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 08:58:31 2022] *** Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: nodename: dv-cinder-803823-12-iscsi Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: machine: x86_64 Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: clock source: unix Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: pcre jit disabled Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: detected number of CPU cores: 4 Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: current working directory: / Jun 22 08:58:31.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: detected binary path: /usr/bin/uwsgi-core Jun 22 08:58:31.400569 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: your processes number limit is 47680 Jun 22 08:58:31.400569 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: your memory page size is 4096 bytes Jun 22 08:58:31.400569 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: detected max file descriptor number: 2048 Jun 22 08:58:31.400569 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: lock engine: pthread robust mutexes Jun 22 08:58:31.400569 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: thunder lock: enabled Jun 22 08:58:31.400569 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 08:58:31.400569 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 08:58:31.443912 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: Python main interpreter initialized at 0x55b1385b89c0 Jun 22 08:58:31.443912 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: python threads support enabled Jun 22 08:58:31.443912 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: your server socket listen backlog is limited to 100 connections Jun 22 08:58:31.443912 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: your mercy for graceful operations on workers is 90 seconds Jun 22 08:58:31.444250 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 08:58:31.444343 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: *** Operational MODE: preforking *** Jun 22 08:58:31.444576 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: *** uWSGI is running in multiple interpreter mode *** Jun 22 08:58:31.444576 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: spawned uWSGI master process (pid: 103890) Jun 22 08:58:31.444763 dv-cinder-803823-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 08:58:31.446128 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: spawned uWSGI worker 1 (pid: 103891, cores: 1) Jun 22 08:58:31.446128 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: spawned uWSGI worker 2 (pid: 103892, cores: 1) Jun 22 08:58:31.446128 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 08:58:32.106555 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:58:32.111235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:58:33.226050 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:58:33.226050 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: from cryptography.utils import int_from_bytes Jun 22 08:58:33.226649 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:58:33.226649 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: from cryptography.utils import int_from_bytes Jun 22 08:58:33.228400 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:58:33.228400 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: from cryptography.utils import int_from_bytes Jun 22 08:58:33.228842 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:58:33.228842 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: from cryptography.utils import int_from_bytes Jun 22 08:58:35.673807 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:58:35.674359 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:58:35.674574 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:58:35.674956 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:58:35.675051 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:58:35.675415 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:58:35.675503 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:58:35.675592 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.675745 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:58:35.675898 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.676106 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:58:35.676203 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.676364 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:58:35.676523 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.676752 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.676849 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.677081 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.677169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.677403 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.677491 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.677722 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.677820 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.678050 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.678145 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.678308 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.678395 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.678619 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.678742 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.678963 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-12-iscsi {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.679056 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.679279 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.679374 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.679575 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.679673 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.679881 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.679975 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.680196 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.680292 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-12-iscsi {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.680497 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.680584 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.680812 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.680898 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.681112 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.681206 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.681431 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.681605 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.681996 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.682128 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.682236 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.682361 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.682469 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.682633 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.682866 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.683059 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.683293 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.683452 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.683551 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.683634 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.683750 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.683895 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.684086 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.684219 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.684399 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.684511 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.684712 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.684819 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.685029 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.685197 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-12-iscsi {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.685336 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.685510 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.685662 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.685820 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.685974 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.686132 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.686378 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-12-iscsi {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.686538 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.686694 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.686901 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.687046 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.687214 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.687354 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.687531 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.687763 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.687866 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.688077 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.688171 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.688389 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.688488 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.688710 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.688817 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.689035 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.689123 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.689344 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.689432 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.689640 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.689727 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.689946 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.690033 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.690253 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.690346 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.690570 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.690666 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.690893 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.690992 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.691198 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.691285 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.691447 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.691609 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.691753 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.691847 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.692067 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.692164 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.692384 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.692481 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.692636 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.692731 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.692945 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.693047 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.693194 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.693289 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.693506 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.693595 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.693822 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.693912 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.694109 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.694205 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.694362 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.694463 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.694680 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.694851 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.695024 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.695113 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.695330 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.695429 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.695636 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.695724 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.695942 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.696029 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.696245 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.696340 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.696554 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.696642 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.696863 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.696951 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.697170 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.697268 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.697473 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.697559 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.697789 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.697877 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.698104 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.698244 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.698415 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.698501 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.698722 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.698809 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.699068 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.699209 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.699391 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.699484 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.699699 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.699795 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.700007 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.700100 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.700324 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.700411 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.700632 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.700726 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.700936 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.701025 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.701246 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.701333 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.701562 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.701648 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.701869 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.701957 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.702177 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.702273 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.702943 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.703039 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.703259 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.703354 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.703565 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.703653 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.703881 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.703977 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.704178 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.704264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.704481 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.704568 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.704783 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.704882 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.705082 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.705173 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.705385 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.705472 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.705691 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.705790 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.705995 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.706082 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.706293 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.706380 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.706595 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.706696 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.706920 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.707010 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.707227 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.707318 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.707529 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.707625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.707832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.707920 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.708133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.708220 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.708441 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.708529 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.708743 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.708829 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.709045 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.709132 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.709336 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.709425 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.709637 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.709726 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.709953 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.710040 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.710258 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.710347 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.710562 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.710658 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.710890 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.710981 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.711193 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.711281 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.711494 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.711581 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.711800 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.711885 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.712103 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.712197 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.712410 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.712497 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.712714 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.712799 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.713008 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.713095 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.713318 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.713406 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.713622 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.713715 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.713925 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.714012 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.714225 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.714312 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.714524 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.714623 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.714838 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.714929 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.715149 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.715235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.715450 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.715551 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.715746 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.715840 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.716047 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.716143 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.716341 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.716440 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.716643 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.716736 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.716946 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.717033 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.717249 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.717348 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.717548 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.717636 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.717850 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.717935 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.718710 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.718817 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.719061 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.719149 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.719376 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.719476 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.719689 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.719779 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.720007 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:58:35.720096 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.720341 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.720429 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.720672 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.720760 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.720993 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.721088 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.721307 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.721414 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.721623 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.721711 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.721950 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.722037 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.722263 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.722359 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.722575 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.722662 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.722907 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.723009 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.723236 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.723332 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.723550 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.723639 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.723864 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.723951 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.724178 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.724290 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.724493 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.724580 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.724811 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.724904 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.725119 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.725263 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.725438 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.725527 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.725754 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.725847 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.726072 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.726166 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.726382 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.726470 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.726700 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.726793 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.728577 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.728740 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.728896 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729048 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729169 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729510 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729599 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729599 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729761 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729854 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.729941 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.730088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.730232 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.730402 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.730513 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.730726 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.730853 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.731070 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.731172 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.731381 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.731483 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.731694 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.731808 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.732008 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.732103 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.732320 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.732419 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.732643 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.732741 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.732956 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.733055 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.733271 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.733371 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.733582 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.733698 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.733923 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.734022 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.734235 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.734331 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.734549 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.734972 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.735144 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.735237 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.735450 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.735552 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.735756 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.735852 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.736061 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.736156 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.736370 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.736470 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.736675 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.736774 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.736994 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.737097 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.737343 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.737450 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.737622 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.737719 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.737929 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.738021 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.738243 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.738339 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.738553 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.738648 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.738900 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.739007 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.739215 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.739309 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.739523 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.739621 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.739840 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.739935 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.740181 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.740280 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.740456 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.740594 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.740782 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.740917 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.741099 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.741281 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.741407 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.741594 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.741735 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.741958 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.742053 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.742326 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.742422 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.742638 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.742732 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.743025 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.743125 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.743347 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.743442 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.743662 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.743755 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.743974 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.744063 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.744299 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.744386 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.744656 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.744829 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.744998 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.745111 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.745337 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.745474 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.745666 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.745767 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.745974 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.746071 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.746287 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.746381 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.746617 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.746712 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.746989 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.747092 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.747302 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.747396 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.747617 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.747715 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.747924 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.748012 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.748230 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.748356 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.748568 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.748808 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.748897 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.749157 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.749256 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.749521 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.749627 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.749828 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.749923 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.750189 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.750285 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.750498 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.750598 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.750835 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.750925 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.751158 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.751253 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.751463 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.751564 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.751781 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.751875 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.752092 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.752186 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.752465 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.752553 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.752773 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.752870 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.753123 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.753211 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.753448 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.753542 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.753763 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.753864 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.754073 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.754172 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.754383 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.754478 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.754690 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.754780 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.755042 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.755157 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.755358 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.755523 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.755704 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.755916 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.756004 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.756305 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.756402 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.756665 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.756752 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.756986 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.757073 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.757305 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.757400 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.757647 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.757741 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.757953 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.758047 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.758292 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.758452 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.758564 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.758836 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.758941 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.759202 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.759302 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.759540 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.759630 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.759855 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.759942 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.760179 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.760269 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.760496 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.760586 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.760810 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.760904 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.761121 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.761210 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.761434 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.761529 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.761746 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.761836 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.762059 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.762156 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.762413 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.762506 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.762758 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.762876 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.763115 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.763214 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.763432 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.763522 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.763757 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.763845 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.764100 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.764242 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.764424 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.764515 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.764730 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.764832 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.765579 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.765722 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.765894 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.765986 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.766217 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.766329 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.766530 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.766619 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.766861 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.766952 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.767179 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.767287 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.767488 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.767576 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.767799 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.767893 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.768112 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.768211 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.768418 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.768552 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.768725 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.768813 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.769106 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.769208 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.769423 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.769538 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.769751 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.769859 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.770068 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.770166 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.770371 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.770458 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.770721 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.770857 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.771100 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.771197 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.771409 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.771520 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.771715 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.771816 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.772029 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.772119 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.772352 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.772440 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.772666 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.772767 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.773022 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.773114 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.773334 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.773434 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.773644 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.773739 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.773948 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.774037 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.774256 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.774344 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.774564 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.774661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.774889 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.774981 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.775195 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.775285 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.775504 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.775661 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.775822 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.775910 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.776140 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.776227 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.776445 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.776545 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.776758 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.776845 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.777065 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.777159 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.777374 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.777462 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.777686 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.777773 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.778028 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.778122 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.778337 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.778433 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.778656 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.778752 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.779012 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.779112 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.779319 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.779463 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.779632 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.779775 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.779944 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.780097 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.780256 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.780478 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.780643 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.781371 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.781471 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.781691 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.781781 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.782005 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.782092 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.782321 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.782426 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.782641 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.782739 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.782978 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.783068 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.783292 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.783380 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.783611 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.783863 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.783951 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.784199 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.784286 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.784516 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.784605 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.784836 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.784932 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.785147 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.785234 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.785464 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.785554 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.785780 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.785910 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.786088 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.786178 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.786403 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.786492 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.786724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.786857 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.787069 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.787311 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.787398 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.787649 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.787739 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.787970 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.788056 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.788277 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.788374 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.788583 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.788717 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.788888 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.788976 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.789197 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.789286 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.789501 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.789602 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.789805 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.789892 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.790107 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.790204 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.790409 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.790505 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.790720 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.790813 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.791102 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.791200 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.791413 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.791509 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.791888 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.792019 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.792019 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.792232 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.792368 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.792455 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.792612 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.792699 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.792916 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.793009 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.793221 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.793318 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.793526 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.793621 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.793835 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.793930 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.794152 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.794248 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.794460 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.794592 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.794779 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.794937 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.795110 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.795199 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.795422 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.795508 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.795738 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.795878 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.796038 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.796125 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.796396 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.796486 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.796701 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.796802 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.797012 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.797100 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.797320 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.797407 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.797624 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.797720 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.797934 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.798022 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.798243 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.798338 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.798552 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.798641 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.798881 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.798972 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.799187 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.799274 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.799498 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.799588 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.799801 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.799889 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.800112 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.800237 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.800421 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.800509 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.800725 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.800820 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.801028 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.801116 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.801339 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.801430 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.801648 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.801737 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.801951 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.802053 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.802260 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.802356 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.802561 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.802649 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.802896 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.803001 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.803202 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.803295 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.803506 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.803604 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.803815 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.803914 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.804127 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.804221 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.804433 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.804527 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.804738 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.804838 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.805049 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.805135 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.805357 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.805452 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.805658 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.805746 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.805961 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.806047 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.806270 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.806360 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.806571 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.806660 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.806895 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.806998 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.807204 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.807292 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.807521 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.807611 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.807836 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.807931 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.808136 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.808221 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.808445 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.808534 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.808748 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.808835 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.809051 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.809153 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.809354 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.809448 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.809659 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.809746 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.809959 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.810055 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.810263 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.810349 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.810562 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.810655 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.810893 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.810995 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.811198 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.811287 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.811510 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.811596 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.811843 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.811941 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.812149 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.812311 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.812450 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.812545 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.812754 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.812843 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.813071 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.813158 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.813378 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.813472 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.813684 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.813773 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.813991 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.814085 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.814299 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.814387 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.814606 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.814695 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.814955 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.815060 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.815268 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.815365 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.815574 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.815662 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.815874 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.815960 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.816179 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.816389 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.816477 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.816556 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.816783 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.816872 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.817085 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.817186 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.817387 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.817475 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.817705 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.817792 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.818017 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.818118 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.818330 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.818425 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.818650 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.818738 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.818991 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.819092 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.819302 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.819390 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.819602 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.819688 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.819908 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.820007 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.820219 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.820314 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.820523 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.820613 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.820827 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.820913 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.821134 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.821228 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.821443 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.821531 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.821753 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.821842 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.822064 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.822159 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.822372 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.822466 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.822680 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.822769 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.823007 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.823096 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.823316 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.823404 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.823626 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.823721 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.823928 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.824023 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.824235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.824331 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.824544 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.824631 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.824847 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.824942 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.825153 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.825251 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.825456 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.825544 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.825766 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.825862 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.826067 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.826164 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.826372 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.826494 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.826685 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.826810 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.827021 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.827144 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.827329 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.827961 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.828178 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.828266 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.828496 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.828593 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.828806 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.828893 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.829119 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.829208 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.829428 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.829517 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.829744 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.829867 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.830051 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.830181 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.830483 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.830572 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.830792 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.830898 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.831124 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.831211 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.831430 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.831519 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.831742 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.831831 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.832056 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.832153 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.832360 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.832454 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.832664 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.832752 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.832968 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.833065 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.833292 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.833388 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.833598 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.833687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.833919 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.834017 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.834296 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.834391 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.834605 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.834699 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.834936 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.835045 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.835255 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.835350 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.835583 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.835672 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.835893 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.835982 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.836203 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.836298 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.836512 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.836606 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.836837 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.836934 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.837147 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.837235 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.837466 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.837565 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.837778 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.837868 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.838100 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.838188 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.838422 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.838509 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.838734 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.838909 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.839091 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.839230 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.839362 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.839548 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.839683 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.839874 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.840004 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.840199 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.840315 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.840527 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.840663 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.840837 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.841032 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.841151 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.841353 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.841469 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.841664 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.841794 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.841985 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.842124 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.842311 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.842440 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.842615 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.842758 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.842943 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.843625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.843821 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.843966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.844135 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.844295 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.844440 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.844615 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.844762 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.844941 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.845081 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.845360 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.845450 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.845670 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.845765 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.845979 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.846076 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.846282 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.846383 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.846585 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.846673 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.846938 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.847041 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.847244 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.847339 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.847555 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.847642 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.847865 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.847962 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.848176 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.848273 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.848494 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.848581 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.848800 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.848890 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.849114 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.849209 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.849421 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.849508 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.849725 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.849816 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.850029 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.850126 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.850332 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.850421 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.850657 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.850790 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.850989 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.851088 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.851311 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.851402 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.851631 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.851727 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.851957 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.852044 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.852265 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.852362 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.852575 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.852662 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.852900 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.852989 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.853211 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.853308 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.853517 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.853604 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.853825 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.853913 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.854131 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.854234 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.854432 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.854519 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.854741 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.854857 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.855070 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.855217 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.855375 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.855464 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.855678 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.855773 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.855987 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.856084 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.856289 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.856374 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.856591 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.856679 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.856893 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.856984 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.857214 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.857303 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.857519 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.857607 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.857843 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.857933 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.858154 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.858242 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.858458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.858545 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.858786 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.858937 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.859114 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.859204 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.859421 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.859516 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.859989 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.860084 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.860297 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.860385 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.860604 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.860701 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.860910 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.861011 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.861240 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.861337 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.861548 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.861649 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.861871 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.861966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.862184 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.862271 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.862494 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.862590 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.862800 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.862955 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.863128 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.863226 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.863444 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.863533 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.863760 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.863855 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.864084 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.864172 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.864396 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.864493 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.864714 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.864802 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.865030 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.865126 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.865344 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.865433 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.865671 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.865859 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.865992 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.866192 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.866314 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.866509 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.866634 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.866877 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.866982 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.867157 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.867256 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.867474 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.867562 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.867791 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.867878 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.868103 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.868206 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.868416 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.868504 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.868726 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.868818 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.869039 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.869129 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.869368 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.869605 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.869702 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.869939 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.870029 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.870258 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.870346 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.870575 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.870664 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.870919 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.871012 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.871241 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.871329 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.871555 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.871643 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.871868 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.871957 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.872184 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.872272 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.872500 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.872597 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.872813 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.872901 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.873129 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.873224 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.873443 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.873548 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.873757 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.873845 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.874075 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.874163 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.874411 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.874511 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.874723 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.874813 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.875058 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.875146 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.875369 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.875459 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.875682 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.875771 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.875996 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.876084 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.876322 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.876418 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.876640 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.876781 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.876958 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.877060 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.877270 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.877357 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.877584 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.877673 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.877897 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.877994 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.878215 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.878409 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.878533 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.878723 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.878867 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.879081 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.879179 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.879407 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.879504 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.879731 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.879829 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.880049 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.880144 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.880367 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.880456 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.880689 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.880785 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.880994 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.881083 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.881299 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.881395 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.881612 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.881709 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.881921 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.882156 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.882245 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.882477 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.882566 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.882813 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.882944 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.883143 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.883229 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.883462 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.883563 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.883771 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.883859 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.884098 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.884305 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.884427 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.884653 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.884742 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.884971 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.885060 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.885297 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.885384 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.885621 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.885710 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.885931 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.886017 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.886234 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.886327 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.886554 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.886646 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.886880 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.886972 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.887188 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.887288 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.887501 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.887590 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.887808 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.888033 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.888128 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.888383 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.888473 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.888700 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.888787 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.889010 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.889098 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.889312 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.889402 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.889622 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.889718 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.890444 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.890542 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.890777 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.890910 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.891112 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.891198 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.891415 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.891511 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.891719 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.891815 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.892032 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.892129 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.892337 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.892433 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.892642 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.892729 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.892947 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.893036 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.893251 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.893348 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.893555 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.893650 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.893857 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.893944 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.894163 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.894258 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.894463 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.894549 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.894778 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.894898 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.895108 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.895199 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.895414 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.895507 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.895730 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.895818 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.896038 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.896127 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.896348 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.896437 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.896647 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.896734 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.896952 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.897040 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.897259 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.897353 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.897566 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.897652 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.897878 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.897967 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.898184 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.898281 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.898503 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.898599 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.898806 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.898927 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.899138 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.899376 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.899492 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.899715 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.899804 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.900041 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.900135 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.900377 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.900472 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.900709 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.900805 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.901017 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.901104 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.901329 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.901418 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.901636 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.901733 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.901947 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.902033 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.902260 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.902356 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.902572 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.902660 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.902904 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.903152 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.903241 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.903492 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.903583 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.903810 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.903898 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.904119 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.904208 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.904430 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.904551 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.904749 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.904846 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.905054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.905153 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.905363 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.905446 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.906212 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.906310 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.906524 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.906627 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.906847 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.906937 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.907176 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.907279 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.907492 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.907591 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.907806 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.907894 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.908116 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.908204 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.908431 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.908521 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.908738 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.908825 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.909047 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.909142 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.909353 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.909441 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.909660 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.909758 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.909970 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.910057 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.910282 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.910371 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.910597 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.910685 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.910921 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.911025 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.911287 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.911375 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.911607 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.911696 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.911924 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.912025 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.912244 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.912333 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.912552 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.912639 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.912862 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.912959 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.913172 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.913267 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.913481 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.913569 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.913796 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.913893 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.914105 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.914191 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.914429 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.914516 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.914737 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.914850 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.915109 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.915195 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.915433 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.915520 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.915738 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.915837 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.916042 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.916130 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.916347 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.916436 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.916659 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.916750 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.916976 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.917065 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.917286 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.917383 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.917589 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.917685 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.917891 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.917980 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.918198 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.918295 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.918500 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.918589 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.918802 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.918956 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.919129 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.919231 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.919435 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.919530 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.919742 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.919830 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.920043 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.920133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.920346 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.920434 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.920647 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.920735 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.920948 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.921038 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.921276 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.921376 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.921577 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.921667 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.921886 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.921976 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.922188 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.922276 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.922490 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.922577 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.922788 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.922932 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.923115 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.923206 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.923418 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.923515 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.923722 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.923850 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.924028 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.924118 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.924333 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.924431 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.924639 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.924734 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.924946 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.925034 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.925252 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.925349 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.925562 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.925651 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.925869 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.925964 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.926173 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.926270 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.926480 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.926569 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.926783 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.926888 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.927113 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.927204 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.927431 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.927518 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.927744 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.927840 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.928057 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.928147 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.928366 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.928462 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.928676 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.928777 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.928986 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.929076 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.929295 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.929390 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.929622 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.929710 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.929927 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.930015 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.930249 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.930336 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.930561 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.930658 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.930899 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.930989 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.931219 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.931307 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.931534 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.931633 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.931850 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.931938 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.932160 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.932246 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.932468 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.932574 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.932782 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.932877 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.933091 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.933177 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.933404 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.933494 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.933721 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.933810 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.934040 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.934136 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.934360 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.934449 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.934683 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.934772 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.935017 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.935107 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.935332 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.935420 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.935656 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.935742 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.935970 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.936066 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.936285 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.936373 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.936606 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.936711 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.936945 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.937049 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.937260 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.937406 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.937571 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.937661 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.937876 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.937974 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.938120 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:58:35.938208 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.938520 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.938848 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.939182 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.939514 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.939861 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.940180 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.940524 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.940853 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.941172 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.941488 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.941794 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:58:35.942040 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:58:36.092431 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO dbcounter [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Registered counter for database nova_api Jun 22 08:58:36.096144 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO dbcounter [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Registered counter for database nova_api Jun 22 08:58:36.113341 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_db.sqlalchemy.engines [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:58:36.115795 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG oslo_db.sqlalchemy.engines [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:58:36.120023 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writer thread running {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:58:36.122242 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writer thread running {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:58:36.177443 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.context [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb77ed2-4ccd-4224-9035-066f22604e48(cell1) {{(pid=103891) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:58:36.179572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.context [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb77ed2-4ccd-4224-9035-066f22604e48(cell1) {{(pid=103892) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:58:36.181308 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:36.182927 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:36.183477 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:36.183714 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:36.185078 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:36.185632 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:36.185860 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:36.188128 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO dbcounter [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Registered counter for database nova_cell0 Jun 22 08:58:36.188353 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:36.190315 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO dbcounter [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Registered counter for database nova_cell0 Jun 22 08:58:36.192250 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO dbcounter [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Registered counter for database nova_cell1 Jun 22 08:58:36.194670 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO dbcounter [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Registered counter for database nova_cell1 Jun 22 08:58:36.199871 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_db.sqlalchemy.engines [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:58:36.201042 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_db.sqlalchemy.engines [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:58:36.203524 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG oslo_db.sqlalchemy.engines [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:58:36.205813 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG oslo_db.sqlalchemy.engines [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:58:36.207362 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writer thread running {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:58:36.210843 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writer thread running {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:58:36.213616 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writer thread running {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:58:36.344841 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writer thread running {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:58:36.354972 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO dbcounter [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Registered counter for database nova_cell0 Jun 22 08:58:36.360316 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO dbcounter [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Registered counter for database nova_cell0 Jun 22 08:58:36.364930 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_db.sqlalchemy.engines [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:58:36.368319 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG oslo_db.sqlalchemy.engines [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:58:36.369249 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writer thread running {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:58:36.372612 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writer thread running {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:58:36.781461 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: WARNING keystonemiddleware.auth_token [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:58:36.788698 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: WARNING keystonemiddleware.auth_token [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:58:36.802091 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: WARNING keystonemiddleware.auth_token [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:58:36.809282 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: WARNING keystonemiddleware.auth_token [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:58:37.127525 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: WARNING keystonemiddleware.auth_token [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:58:37.133380 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: WARNING keystonemiddleware.auth_token [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:58:37.138610 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b1385b89c0 pid: 103891 (default app) Jun 22 08:58:37.141195 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:37.142361 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002232 Jun 22 08:58:37.142765 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Wed Jun 22 08:58:37 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:37.144541 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: WARNING keystonemiddleware.auth_token [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:58:37.150443 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: WARNING keystonemiddleware.auth_token [None req-85d96a2e-2862-4ba8-b780-44913139e3da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:58:37.156216 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b1385b89c0 pid: 103892 (default app) Jun 22 08:59:54.722728 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:54.723768 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 22 08:59:54.724153 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 08:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:54.737163 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_api:SELECT=3 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:54.738286 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_cell1:SELECT=3 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:54.739305 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_cell0:SELECT=3 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:54.740585 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:55.173381 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8854f65f-f690-46b3-adc0-a724fd35aae0 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:55.203053 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8854f65f-f690-46b3-adc0-a724fd35aae0 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.472002 Jun 22 08:59:55.203897 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 22 08:59:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:57.284943 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:57.285929 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-b5e2a9fb-990b-400f-9959-9127dc7ecde3 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 22 08:59:57.286330 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 3/4] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 08:59:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:57.345294 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-617a45cf-eef8-40a4-8401-661701ae0915 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "swap": 0, "vcpus": 1, "id": "c1", "disk": 1}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:57.363981 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:59:57.363981 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: warnings.warn(msg) Jun 22 08:59:57.461236 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-617a45cf-eef8-40a4-8401-661701ae0915 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.168867 Jun 22 08:59:57.461814 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 2/5] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 08:59:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:59:57.476902 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_api:SELECT=3 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:57.478114 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_cell0:SELECT=3 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:57.479214 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_cell1:SELECT=3 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:57.479965 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:57.684846 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-646decc9-ec92-4cf7-936b-a005414baa5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:57.687253 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:59:57.687253 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: warnings.warn(msg) Jun 22 08:59:57.795719 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-646decc9-ec92-4cf7-936b-a005414baa5e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.324667 Jun 22 08:59:57.796508 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 4/6] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 22 08:59:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:59:59.863709 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-617a45cf-eef8-40a4-8401-661701ae0915 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:59:59.864766 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-617a45cf-eef8-40a4-8401-661701ae0915 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jun 22 08:59:59.865163 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 3/7] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 08:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:59:59.969002 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-b419071e-3ebf-4707-bfee-c1b329fa0c60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "disk": 5}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:59:59.987606 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:59:59.987606 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: warnings.warn(msg) Jun 22 09:00:00.085563 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-b419071e-3ebf-4707-bfee-c1b329fa0c60 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.214437 Jun 22 09:00:00.086343 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 5/8] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 08:59:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 09:00:00.098605 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-d6581a51-2177-4d43-ad22-a2c10f299844 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:00.100391 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:00:00.100391 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: warnings.warn(msg) Jun 22 09:00:00.221159 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-d6581a51-2177-4d43-ad22-a2c10f299844 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126121 Jun 22 09:00:00.221838 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 4/9] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 22 09:00:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:02.295619 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-b419071e-3ebf-4707-bfee-c1b329fa0c60 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:02.296742 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-b419071e-3ebf-4707-bfee-c1b329fa0c60 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Jun 22 09:00:02.297429 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:02.364812 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-cec6db4a-6d3e-4a93-99b4-460af6f9b43f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:02.444859 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-cec6db4a-6d3e-4a93-99b4-460af6f9b43f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141505 Jun 22 09:00:02.445711 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 5/11] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 09:00:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:00:02.457894 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-5d2278c9-ef42-42b4-b9ef-9d20645ffe3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:02.540526 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-5d2278c9-ef42-42b4-b9ef-9d20645ffe3a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086340 Jun 22 09:00:02.549744 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 7/12] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 22 09:00:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:04.631688 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-cec6db4a-6d3e-4a93-99b4-460af6f9b43f admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:04.632695 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-cec6db4a-6d3e-4a93-99b4-460af6f9b43f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 22 09:00:04.633086 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 6/13] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:04.690296 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-d38bb89b-29ea-46f2-ac46-45bab560ae49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:04.774538 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-d38bb89b-29ea-46f2-ac46-45bab560ae49 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135645 Jun 22 09:00:04.775133 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 8/14] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 09:00:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:00:04.787104 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-075ffab1-84f5-418e-9069-b232b6834d5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:04.869656 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-075ffab1-84f5-418e-9069-b232b6834d5b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086070 Jun 22 09:00:04.870207 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 7/15] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 22 09:00:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:06.970203 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-d38bb89b-29ea-46f2-ac46-45bab560ae49 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:06.971791 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-d38bb89b-29ea-46f2-ac46-45bab560ae49 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Jun 22 09:00:06.972626 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 9/16] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:07.050403 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-b4ecb14b-b626-4963-b5ff-7baa2ea57e9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:07.137981 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-b4ecb14b-b626-4963-b5ff-7baa2ea57e9d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157938 Jun 22 09:00:07.138704 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 8/17] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 09:00:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:00:07.150774 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-081961b9-553f-495a-8d1a-ae4beaacb90c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:07.232177 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-081961b9-553f-495a-8d1a-ae4beaacb90c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084964 Jun 22 09:00:07.232790 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 10/18] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 22 09:00:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:09.299746 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-b4ecb14b-b626-4963-b5ff-7baa2ea57e9d admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:09.300723 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-b4ecb14b-b626-4963-b5ff-7baa2ea57e9d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 22 09:00:09.305468 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 9/19] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:09 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:09.368953 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-873e97b3-fb2e-4988-b2fa-ab2186d29de8 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:09.393563 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-873e97b3-fb2e-4988-b2fa-ab2186d29de8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086803 Jun 22 09:00:09.394110 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 22 09:00:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:00:11.507135 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-b4ecb14b-b626-4963-b5ff-7baa2ea57e9d admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:11.508154 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-b4ecb14b-b626-4963-b5ff-7baa2ea57e9d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 22 09:00:11.508586 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 10/21] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:11.571575 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-446bc7c4-1aba-404c-aab7-e273e8d80a70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny"}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:11.646804 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-446bc7c4-1aba-404c-aab7-e273e8d80a70 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.131286 Jun 22 09:00:11.647693 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 12/22] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 09:00:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:00:11.662170 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-7a83b9ec-e6c0-4f57-a0bc-009ef9c94b1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:11.757531 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-7a83b9ec-e6c0-4f57-a0bc-009ef9c94b1b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099003 Jun 22 09:00:11.758108 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 11/23] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 22 09:00:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:14.199964 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-446bc7c4-1aba-404c-aab7-e273e8d80a70 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:14.200992 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-446bc7c4-1aba-404c-aab7-e273e8d80a70 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Jun 22 09:00:14.201386 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:14.261054 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-b18311c9-1520-42c5-b398-703d531567f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "2"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:14.331936 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-b18311c9-1520-42c5-b398-703d531567f2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.124671 Jun 22 09:00:14.333144 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 12/25] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 09:00:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 09:00:14.344639 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-2b45ee12-51a0-4f15-83c5-3b798a2b629b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:14.442630 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-2b45ee12-51a0-4f15-83c5-3b798a2b629b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101585 Jun 22 09:00:14.443246 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 14/26] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 22 09:00:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:16.937683 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-b18311c9-1520-42c5-b398-703d531567f2 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:16.938688 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-b18311c9-1520-42c5-b398-703d531567f2 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 22 09:00:16.939213 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:16.997299 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-87f4ae4c-3a75-4dff-b9f8-77ddc6b3c312 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "disk": 40}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:17.078921 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-87f4ae4c-3a75-4dff-b9f8-77ddc6b3c312 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133645 Jun 22 09:00:17.079478 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 15/28] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 09:00:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 09:00:17.091927 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-deccde0b-81db-445e-9933-b01d6d2469ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:17.172768 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-deccde0b-81db-445e-9933-b01d6d2469ce admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084566 Jun 22 09:00:17.173353 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 14/29] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 22 09:00:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:19.365447 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-87f4ae4c-3a75-4dff-b9f8-77ddc6b3c312 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:19.365447 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-87f4ae4c-3a75-4dff-b9f8-77ddc6b3c312 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 22 09:00:19.365447 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:19.434030 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-e72485e1-ac26-4b74-aa03-175dc1fba78c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "id": "4", "vcpus": 4, "disk": 80}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:19.550340 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-e72485e1-ac26-4b74-aa03-175dc1fba78c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.180252 Jun 22 09:00:19.550809 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 15/31] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 09:00:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:00:19.563124 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-338687cb-6cec-4988-9c92-9679e2e6dd83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:19.671092 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-338687cb-6cec-4988-9c92-9679e2e6dd83 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111462 Jun 22 09:00:19.671991 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 17/32] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 22 09:00:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:21.732835 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-e72485e1-ac26-4b74-aa03-175dc1fba78c admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:21.733835 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-e72485e1-ac26-4b74-aa03-175dc1fba78c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 22 09:00:21.735888 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 16/33] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:21.804998 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-bbfa649b-106f-4a48-bf46-0219a54171c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "disk": 160}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:21.883457 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-bbfa649b-106f-4a48-bf46-0219a54171c5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.141635 Jun 22 09:00:21.886872 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 18/34] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 22 09:00:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:00:21.895706 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-e509c540-3267-477f-ad29-ef9fdccd1271 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:21.990136 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-e509c540-3267-477f-ad29-ef9fdccd1271 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098036 Jun 22 09:00:21.990853 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 17/35] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 22 09:00:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:46.162380 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-bbfa649b-106f-4a48-bf46-0219a54171c5 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:46.163433 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-bbfa649b-106f-4a48-bf46-0219a54171c5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 22 09:00:46.163875 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 19/36] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:00:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:46.174951 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:46.222565 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-9ed03073-fd15-42f2-8177-b6df396f62e2 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:46.240073 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-9ed03073-fd15-42f2-8177-b6df396f62e2 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069715 Jun 22 09:00:46.240593 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 22 09:00:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:00:47.150968 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-bbfa649b-106f-4a48-bf46-0219a54171c5 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.152077 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-bbfa649b-106f-4a48-bf46-0219a54171c5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 22 09:00:47.152473 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:47.342215 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8d011ed5-1ff4-40ae-bcb6-f6396dbc8d33 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.348834 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.wsgi [None req-8d011ed5-1ff4-40ae-bcb6-f6396dbc8d33 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8d011ed5-1ff4-40ae-bcb6-f6396dbc8d33 admin admin] Request method failure captured: Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Accept: application/json Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Accept-Encoding: gzip, deflate Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Connection: keep-alive Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Content-Length: 0 Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Host: 10.222.0.55 Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Openstack-Api-Version: compute 2.90 Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Openstack-System-Scope: None Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: User-Agent: python-novaclient Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Auth-Token: gAAAAABisto_KlH6fIqJNhLhkbNeY5Z3Ts_sf6V5YDfQDhJyxYALB5uTuxNgON-SlzEyWWGtSnZFdUVMR2VD69lxl0MAnVr95sj_Ji-5U22uklvTccm9xgl0NxoKu8gNyHJ-XYnHKc3UnlF-xVlIbMWbMwkpGCyReujrYQ112vluskViZfEfWww Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Domain-Id: None Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Domain-Name: None Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Identity-Status: Confirmed Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Is-Admin-Project: True Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Domain-Id: default Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Domain-Name: Default Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Name: admin Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Role: member,reader,admin Jun 22 09:00:47.351133 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Roles: member,reader,admin Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}] Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Tenant: admin Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Tenant-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Tenant-Name: admin Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User: admin Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Domain-Id: default Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Domain-Name: Default Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Id: 980b07a4628a4a1da4fc1c5439c8f483 Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Name: admin Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: method: > Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: exception: Flavor 42 could not be found. Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: action_args: {'id': '42'} Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:47.352687 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:47.353599 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.354784 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8d011ed5-1ff4-40ae-bcb6-f6396dbc8d33 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:47.355848 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8d011ed5-1ff4-40ae-bcb6-f6396dbc8d33 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062445 Jun 22 09:00:47.355848 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:47.362473 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-1d6598cb-4fe6-4f37-a857-e362c799b4fe admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.365419 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:47.383620 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-1d6598cb-4fe6-4f37-a857-e362c799b4fe admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025058 Jun 22 09:00:47.384153 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:00:47.394538 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-f198a61f-27c6-4df4-b459-beabb5312716 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.417615 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-f198a61f-27c6-4df4-b459-beabb5312716 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026695 Jun 22 09:00:47.418251 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:00:47.427533 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-4e4e6d3b-ab91-4046-be98-d30c867f1469 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.433573 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.wsgi [None req-4e4e6d3b-ab91-4046-be98-d30c867f1469 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-4e4e6d3b-ab91-4046-be98-d30c867f1469 admin admin] Request method failure captured: Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Accept: application/json Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Accept-Encoding: gzip, deflate Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Connection: keep-alive Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Content-Length: 0 Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Host: 10.222.0.55 Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Openstack-Api-Version: compute 2.90 Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Openstack-System-Scope: None Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: User-Agent: python-novaclient Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Auth-Token: gAAAAABisto_KlH6fIqJNhLhkbNeY5Z3Ts_sf6V5YDfQDhJyxYALB5uTuxNgON-SlzEyWWGtSnZFdUVMR2VD69lxl0MAnVr95sj_Ji-5U22uklvTccm9xgl0NxoKu8gNyHJ-XYnHKc3UnlF-xVlIbMWbMwkpGCyReujrYQ112vluskViZfEfWww Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Domain-Id: None Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Domain-Name: None Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Identity-Status: Confirmed Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Is-Admin-Project: True Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Domain-Id: default Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Domain-Name: Default Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Name: admin Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Role: member,reader,admin Jun 22 09:00:47.436832 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Roles: member,reader,admin Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}] Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Tenant: admin Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Tenant-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Tenant-Name: admin Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User: admin Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Domain-Id: default Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Domain-Name: Default Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Id: 980b07a4628a4a1da4fc1c5439c8f483 Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Name: admin Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: method: > Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: exception: Flavor 42 could not be found. Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: action_args: {'id': '42'} Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:47.438148 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:47.439088 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.440458 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-4e4e6d3b-ab91-4046-be98-d30c867f1469 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:47.441816 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-4e4e6d3b-ab91-4046-be98-d30c867f1469 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014252 Jun 22 09:00:47.441816 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 09:00:48.253301 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-f198a61f-27c6-4df4-b459-beabb5312716 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.254494 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-f198a61f-27c6-4df4-b459-beabb5312716 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jun 22 09:00:48.254901 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 21/43] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:48.442524 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-9be9e16d-0e1b-4006-b1bb-83f2b935afdf admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.447687 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.wsgi [None req-9be9e16d-0e1b-4006-b1bb-83f2b935afdf admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-9be9e16d-0e1b-4006-b1bb-83f2b935afdf admin admin] Request method failure captured: Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Accept: application/json Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Accept-Encoding: gzip, deflate Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Connection: keep-alive Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Content-Length: 0 Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Host: 10.222.0.55 Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Openstack-Api-Version: compute 2.90 Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Openstack-System-Scope: None Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: User-Agent: python-novaclient Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Auth-Token: gAAAAABistpAi8-9SYNq3aXFyHkmbUC2DOE3y_-uTzlBx2WY3F2X5RqFUgwxst4JZNzwAYYqUvgB7_wRUc1YpiEoxqFLuN8n9gVqNYaS08zh0YJIHBuK1l7e8tCsxIZ5J1dUY44s-RxByADzoqjP_I4oKSHHlyn3NRlX6txln2a1StXyXImVKoc Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Domain-Id: None Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Domain-Name: None Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Identity-Status: Confirmed Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Is-Admin-Project: True Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Domain-Id: default Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Domain-Name: Default Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Name: admin Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Role: member,reader,admin Jun 22 09:00:48.449169 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Roles: member,reader,admin Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}] Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Tenant: admin Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Tenant-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Tenant-Name: admin Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User: admin Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Domain-Id: default Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Domain-Name: Default Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Id: 980b07a4628a4a1da4fc1c5439c8f483 Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Name: admin Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: method: > Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: exception: Flavor 84 could not be found. Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: action_args: {'id': '84'} Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:48.450724 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:48.451661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.453054 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-9be9e16d-0e1b-4006-b1bb-83f2b935afdf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:48.454455 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-9be9e16d-0e1b-4006-b1bb-83f2b935afdf admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059966 Jun 22 09:00:48.454455 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 23/44] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:48.460319 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-46047d13-64d7-47c5-8723-cc76a91fe66d admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.474217 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-46047d13-64d7-47c5-8723-cc76a91fe66d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017422 Jun 22 09:00:48.474665 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:00:48.484789 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-55b58d88-d9c9-47b0-b437-dca6704fa390 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.500004 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-55b58d88-d9c9-47b0-b437-dca6704fa390 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019057 Jun 22 09:00:48.500528 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:00:48.509708 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-ac5754c9-33f8-4fa9-8346-9ac512086b60 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.514945 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.wsgi [None req-ac5754c9-33f8-4fa9-8346-9ac512086b60 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-ac5754c9-33f8-4fa9-8346-9ac512086b60 admin admin] Request method failure captured: Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Accept: application/json Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Accept-Encoding: gzip, deflate Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Connection: keep-alive Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Content-Length: 0 Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Host: 10.222.0.55 Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Openstack-Api-Version: compute 2.90 Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Openstack-System-Scope: None Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: User-Agent: python-novaclient Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Auth-Token: gAAAAABistpAi8-9SYNq3aXFyHkmbUC2DOE3y_-uTzlBx2WY3F2X5RqFUgwxst4JZNzwAYYqUvgB7_wRUc1YpiEoxqFLuN8n9gVqNYaS08zh0YJIHBuK1l7e8tCsxIZ5J1dUY44s-RxByADzoqjP_I4oKSHHlyn3NRlX6txln2a1StXyXImVKoc Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Domain-Id: None Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Domain-Name: None Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Identity-Status: Confirmed Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Is-Admin-Project: True Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Domain-Id: default Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Domain-Name: Default Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Name: admin Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Role: member,reader,admin Jun 22 09:00:48.516426 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Roles: member,reader,admin Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}] Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Tenant: admin Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Tenant-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Tenant-Name: admin Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User: admin Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Domain-Id: default Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Domain-Name: Default Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Id: 980b07a4628a4a1da4fc1c5439c8f483 Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Name: admin Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: method: > Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: exception: Flavor 84 could not be found. Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: action_args: {'id': '84'} Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:48.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:48.518899 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:48.520003 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-ac5754c9-33f8-4fa9-8346-9ac512086b60 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:48.521054 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-ac5754c9-33f8-4fa9-8346-9ac512086b60 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011594 Jun 22 09:00:48.521054 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 23/47] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 09:00:49.325278 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-55b58d88-d9c9-47b0-b437-dca6704fa390 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:49.326266 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-55b58d88-d9c9-47b0-b437-dca6704fa390 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 22 09:00:49.326661 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 25/48] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:49.514690 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-510affbe-2492-4832-8ae5-4b899e3eae16 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:49.520136 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.wsgi [None req-510affbe-2492-4832-8ae5-4b899e3eae16 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-510affbe-2492-4832-8ae5-4b899e3eae16 admin admin] Request method failure captured: Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Accept: application/json Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Accept-Encoding: gzip, deflate Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Connection: keep-alive Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Content-Length: 0 Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Host: 10.222.0.55 Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Openstack-Api-Version: compute 2.90 Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Openstack-System-Scope: None Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: User-Agent: python-novaclient Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Auth-Token: gAAAAABistpBklBk_UXZvX_q9l1siBkPKeb3OAjSkasf6w1YnqDVLkcUX6423tbtMlnHbBZnSE143KZg83zktjlV0yqPMhUIi3OsLzAcwXIkbMtBDkvKeq1sSe-3Njmca7dMyfXSygD81pTrblrQat1HSqQgELyuxAnxCoR1V7NoMXF1UTsOEM4 Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Domain-Id: None Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Domain-Name: None Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Identity-Status: Confirmed Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Is-Admin-Project: True Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Domain-Id: default Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Domain-Name: Default Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Project-Name: admin Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Role: member,reader,admin Jun 22 09:00:49.521625 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Roles: member,reader,admin Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}] Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Tenant: admin Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Tenant-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-Tenant-Name: admin Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User: admin Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Domain-Id: default Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Domain-Name: Default Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Id: 980b07a4628a4a1da4fc1c5439c8f483 Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: X-User-Name: admin Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: method: > Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: exception: Flavor 451 could not be found. Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: action_args: {'id': '451'} Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:49.523245 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:49.524235 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.525572 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-510affbe-2492-4832-8ae5-4b899e3eae16 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:49.526812 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-510affbe-2492-4832-8ae5-4b899e3eae16 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060488 Jun 22 09:00:49.526812 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 24/49] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 22 09:00:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:49.532464 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-29e356d4-0e0b-4e30-b28c-8151a97320bd admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:49.546575 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-29e356d4-0e0b-4e30-b28c-8151a97320bd admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017629 Jun 22 09:00:49.547197 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 26/50] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 22 09:00:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:00:49.557097 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:49.570786 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017806 Jun 22 09:00:49.571330 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 22 09:00:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:00:49.580461 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-73f90842-8a36-4c30-811a-1a913390d078 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:49.585705 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.wsgi [None req-73f90842-8a36-4c30-811a-1a913390d078 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-73f90842-8a36-4c30-811a-1a913390d078 admin admin] Request method failure captured: Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Accept: application/json Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Accept-Encoding: gzip, deflate Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Connection: keep-alive Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Content-Length: 0 Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Host: 10.222.0.55 Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Openstack-Api-Version: compute 2.90 Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Openstack-System-Scope: None Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: User-Agent: python-novaclient Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Auth-Token: gAAAAABistpBklBk_UXZvX_q9l1siBkPKeb3OAjSkasf6w1YnqDVLkcUX6423tbtMlnHbBZnSE143KZg83zktjlV0yqPMhUIi3OsLzAcwXIkbMtBDkvKeq1sSe-3Njmca7dMyfXSygD81pTrblrQat1HSqQgELyuxAnxCoR1V7NoMXF1UTsOEM4 Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Domain-Id: None Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Domain-Name: None Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Identity-Status: Confirmed Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Is-Admin-Project: True Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Domain-Id: default Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Domain-Name: Default Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Project-Name: admin Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Role: member,reader,admin Jun 22 09:00:49.587262 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Roles: member,reader,admin Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/220b7f5f59544863b1dda75a37a7b01f"}]}] Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Tenant: admin Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Tenant-Id: 220b7f5f59544863b1dda75a37a7b01f Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-Tenant-Name: admin Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User: admin Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Domain-Id: default Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Domain-Name: Default Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Id: 980b07a4628a4a1da4fc1c5439c8f483 Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: X-User-Name: admin Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: method: > Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: exception: Flavor 451 could not be found. Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: action_args: {'id': '451'} Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:49.588763 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:49.589949 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: ERROR nova.api.openstack.wsgi Jun 22 09:00:49.591264 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-73f90842-8a36-4c30-811a-1a913390d078 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:49.592512 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-73f90842-8a36-4c30-811a-1a913390d078 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011722 Jun 22 09:00:49.592512 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 27/52] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 22 09:00:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:50.465816 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:50.466844 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jun 22 09:00:50.467254 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:50.655995 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-76696fdb-08cc-45f7-b564-afd98bb70234 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:50.733704 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-76696fdb-08cc-45f7-b564-afd98bb70234 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.128962 Jun 22 09:00:50.734510 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 28/54] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 22 09:00:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:00:51.559356 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:51.560389 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 22 09:00:51.560789 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:00:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:51.749731 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-de112814-6e71-41df-8bf8-801242ecec47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:51.813780 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-de112814-6e71-41df-8bf8-801242ecec47 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.115465 Jun 22 09:00:51.814249 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 29/56] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 22 09:00:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:00:52.627749 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:52.628953 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001876 Jun 22 09:00:52.629478 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:52.817126 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-5078533d-50cb-4c02-b085-975027b677db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:52.895493 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-5078533d-50cb-4c02-b085-975027b677db admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.128960 Jun 22 09:00:52.895969 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 30/58] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 22 09:00:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 09:00:53.716004 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:53.717012 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 22 09:00:53.717411 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 29/59] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:00:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:53.904667 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-aeeca9c5-d8b0-4a4e-88a5-1361a7d9db0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:53.991359 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-aeeca9c5-d8b0-4a4e-88a5-1361a7d9db0e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.137723 Jun 22 09:00:53.991834 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 22 09:00:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:00:54.805216 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:54.806218 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 22 09:00:54.806613 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 30/61] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:54.993025 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-ed3239a0-bfbb-43f0-9b6c-b0bdd9b876c8 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:55.012190 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-ed3239a0-bfbb-43f0-9b6c-b0bdd9b876c8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069485 Jun 22 09:00:55.013083 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 32/62] 10.222.0.55 () {60 vars in 1202 bytes} [Wed Jun 22 09:00:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:01:41.629797 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:41.630801 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8331ed85-bbb5-43f9-8111-554e824aadd6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 22 09:01:41.631225 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 31/63] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 22 09:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:41.642063 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:41.689081 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-2d1b7513-91cc-4387-b872-680b9a040ba8 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:41.708241 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-2d1b7513-91cc-4387-b872-680b9a040ba8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070608 Jun 22 09:01:41.708773 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 22 09:01:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:01:41.730958 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-d02e4e03-a0ce-40fc-9ce8-35e46b0def1f admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:41.734713 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_api:SELECT=14 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:41.739598 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-d02e4e03-a0ce-40fc-9ce8-35e46b0def1f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012211 Jun 22 09:01:41.740101 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 32/65] 10.222.0.55 () {60 vars in 1282 bytes} [Wed Jun 22 09:01:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:41.753514 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-8373937a-fcf9-4020-a475-bd998265782f admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:41.762064 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-8373937a-fcf9-4020-a475-bd998265782f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012212 Jun 22 09:01:41.762571 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 34/66] 10.222.0.55 () {60 vars in 1285 bytes} [Wed Jun 22 09:01:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:41.773708 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:41.781329 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011172 Jun 22 09:01:41.781837 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1285 bytes} [Wed Jun 22 09:01:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:41.792551 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-d60da0ae-fcc5-44d5-8061-071af16da80f admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:41.800206 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-d60da0ae-fcc5-44d5-8061-071af16da80f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011092 Jun 22 09:01:41.800751 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1282 bytes} [Wed Jun 22 09:01:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:05.403994 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:05.404991 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 22 09:05:05.405380 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:05:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:05:05.547872 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_api:SELECT=6 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:05.661183 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-9f59185e-ca99-4a2c-b8a2-1609a60449d1 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:05.662379 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:05:05.662379 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: warnings.warn(msg) Jun 22 09:05:05.663625 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-9f59185e-ca99-4a2c-b8a2-1609a60449d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:05.664096 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-9f59185e-ca99-4a2c-b8a2-1609a60449d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:05.664868 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-9f59185e-ca99-4a2c-b8a2-1609a60449d1 admin admin] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:05.665291 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-9f59185e-ca99-4a2c-b8a2-1609a60449d1 admin admin] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:05.698408 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-9f59185e-ca99-4a2c-b8a2-1609a60449d1 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.152073 Jun 22 09:05:05.698981 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 36/70] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 22 09:05:05 2022] GET /compute/v2.1/os-services => generated 794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:05:06.573365 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:06.574364 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 22 09:05:06.574757 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:06.770589 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-e798bf3f-4be8-44a5-bb4b-66c4e035f014 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:06.771820 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:05:06.771820 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: warnings.warn(msg) Jun 22 09:05:06.773037 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-e798bf3f-4be8-44a5-bb4b-66c4e035f014 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:06.773475 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-e798bf3f-4be8-44a5-bb4b-66c4e035f014 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:06.774263 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-e798bf3f-4be8-44a5-bb4b-66c4e035f014 admin admin] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:06.774688 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-e798bf3f-4be8-44a5-bb4b-66c4e035f014 admin admin] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:06.794290 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-e798bf3f-4be8-44a5-bb4b-66c4e035f014 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081267 Jun 22 09:05:06.794844 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 37/72] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 22 09:05:06 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:05:18.029287 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:18.030286 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 22 09:05:18.030676 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 36/73] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:05:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:18.172179 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_cell0:SELECT=4 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:18.172907 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_cell1:SELECT=4 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:18.173521 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG dbcounter [-] [103891] Writing DB stats nova_api:SELECT=8 {{(pid=103891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:18.220957 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-169db5bb-2524-4221-991b-c3e628a71598 admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:18.222161 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:05:18.222161 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: warnings.warn(msg) Jun 22 09:05:18.223363 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-169db5bb-2524-4221-991b-c3e628a71598 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.224445 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-169db5bb-2524-4221-991b-c3e628a71598 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.224601 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-169db5bb-2524-4221-991b-c3e628a71598 admin admin] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.224970 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-169db5bb-2524-4221-991b-c3e628a71598 admin admin] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.255002 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-169db5bb-2524-4221-991b-c3e628a71598 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082941 Jun 22 09:05:18.255002 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 22 09:05:18 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:19.111142 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:19.112164 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-0e3edad8-0a25-46d2-9b5e-3b81ba4e367c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 22 09:05:19.112553 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 22 09:05:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:19.303820 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG nova.api.openstack.wsgi [None req-d327d2bf-c03f-4e82-bc0b-bff7fd7d97ae admin admin] Calling method '>' {{(pid=103891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:19.305013 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:05:19.305013 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: warnings.warn(msg) Jun 22 09:05:19.306193 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-d327d2bf-c03f-4e82-bc0b-bff7fd7d97ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:19.306629 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-d327d2bf-c03f-4e82-bc0b-bff7fd7d97ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:19.307734 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-d327d2bf-c03f-4e82-bc0b-bff7fd7d97ae admin admin] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:19.308346 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: DEBUG oslo_concurrency.lockutils [None req-d327d2bf-c03f-4e82-bc0b-bff7fd7d97ae admin admin] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:19.330595 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: INFO nova.api.openstack.requestlog [None req-d327d2bf-c03f-4e82-bc0b-bff7fd7d97ae admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078151 Jun 22 09:05:19.331739 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: [pid: 103891|app: 0|req: 39/76] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 22 09:05:19 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:16.003495 dv-cinder-803823-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 09:06:16.004072 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: Wed Jun 22 09:06:16 2022 - graceful shutdown triggered... Jun 22 09:06:16.004567 dv-cinder-803823-12-iscsi devstack@n-api.service[103892]: Gracefully killing worker 2 (pid: 103892)... Jun 22 09:06:16.005055 dv-cinder-803823-12-iscsi devstack@n-api.service[103891]: Gracefully killing worker 1 (pid: 103891)... Jun 22 09:06:17.005217 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: worker 1 buried after 1 seconds Jun 22 09:06:17.005767 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: worker 2 buried after 1 seconds Jun 22 09:06:17.005767 dv-cinder-803823-12-iscsi devstack@n-api.service[103890]: goodbye to uWSGI. Jun 22 09:06:17.006798 dv-cinder-803823-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 09:06:17.007384 dv-cinder-803823-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 09:06:17.010122 dv-cinder-803823-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 09:06:17.019234 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 09:06:17 2022] *** Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: nodename: dv-cinder-803823-12-iscsi Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: machine: x86_64 Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: clock source: unix Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: pcre jit disabled Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: detected number of CPU cores: 4 Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: current working directory: / Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: detected binary path: /usr/bin/uwsgi-core Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: your processes number limit is 47680 Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: your memory page size is 4096 bytes Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: detected max file descriptor number: 2048 Jun 22 09:06:17.021227 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: lock engine: pthread robust mutexes Jun 22 09:06:17.022118 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: thunder lock: enabled Jun 22 09:06:17.022118 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 09:06:17.022118 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 09:06:17.067535 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: Python main interpreter initialized at 0x5653458e39c0 Jun 22 09:06:17.067535 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: python threads support enabled Jun 22 09:06:17.067535 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: your server socket listen backlog is limited to 100 connections Jun 22 09:06:17.067535 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: your mercy for graceful operations on workers is 90 seconds Jun 22 09:06:17.067986 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 09:06:17.067986 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: *** Operational MODE: preforking *** Jun 22 09:06:17.068274 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: *** uWSGI is running in multiple interpreter mode *** Jun 22 09:06:17.068274 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: spawned uWSGI master process (pid: 118245) Jun 22 09:06:17.068510 dv-cinder-803823-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 09:06:17.068753 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: spawned uWSGI worker 1 (pid: 118267, cores: 1) Jun 22 09:06:17.069256 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: spawned uWSGI worker 2 (pid: 118268, cores: 1) Jun 22 09:06:17.069534 dv-cinder-803823-12-iscsi devstack@n-api.service[118245]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 09:06:17.725343 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 09:06:17.728461 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 09:06:18.928040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 09:06:18.928040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: from cryptography.utils import int_from_bytes Jun 22 09:06:18.928668 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 09:06:18.928668 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: from cryptography.utils import int_from_bytes Jun 22 09:06:18.929153 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 09:06:18.929153 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: from cryptography.utils import int_from_bytes Jun 22 09:06:18.929599 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 09:06:18.929599 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: from cryptography.utils import int_from_bytes Jun 22 09:06:21.316997 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 09:06:21.317586 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 09:06:21.317825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 09:06:21.318136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 09:06:21.318387 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 09:06:21.318768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.319116 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.319442 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.319758 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.320087 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.320395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.320708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.321021 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.321347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.321638 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.321947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.322269 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-12-iscsi {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.322585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.322911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.323028 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 09:06:21.323410 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.323504 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 09:06:21.323580 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.323760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 09:06:21.323868 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.324108 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.324218 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 09:06:21.324380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 09:06:21.324537 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.324911 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.325091 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.325209 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.326464 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.326597 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.326685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.326760 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.327005 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.327244 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.327479 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.327702 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.327912 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.328133 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.328352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.328585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.328813 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.329035 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.329256 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.329481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.329720 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.329942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.330161 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-12-iscsi {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.330383 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.330605 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.330605 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.331186 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-12-iscsi {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.331423 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.331635 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.331854 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.332073 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.332297 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.332488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.332690 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.332880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.333063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.333250 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.333250 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.333551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.333725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.333872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.334047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.334222 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.334380 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.334536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.334679 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.334875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.335027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.335185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.335382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.335538 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.335691 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.335851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.336006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.336715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.336900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.337078 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.337224 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.338125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.338286 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.338454 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-12-iscsi {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.338605 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.338759 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.338956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.338956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.339249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.339395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.339551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.340638 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.340822 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.340980 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.341141 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.341294 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.341453 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.341598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.341744 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.341889 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.342049 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.342204 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.342358 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.342521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.342668 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.342889 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.343085 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.343234 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.343355 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.343476 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.343595 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.343720 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.343841 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.343960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.344072 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.344184 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.344304 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.344430 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.344543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.344543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.344765 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.344884 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.344884 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.345109 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.345219 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.345337 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.345448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.345567 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.346210 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.346708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.346872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.346995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.353923 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.354379 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.354545 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.354722 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.354952 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.355117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.355272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.355433 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.355602 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.355749 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.355905 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.356065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.356210 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.356367 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.356575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.356744 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.356899 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357188 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357505 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357680 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357830 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.357995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.359136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.359136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.359136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.359136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.359136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.359136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.359136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.360103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.362489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.363300 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.363473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.363630 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.363787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.363934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.364108 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.364271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.364418 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.364418 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.364710 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.364863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.365016 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.365181 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.365328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.365483 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.365886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.366042 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.366190 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.366684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.366936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.369266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.369266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.369266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.369266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.369266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.369266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.369266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.369266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.371097 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.371097 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.371097 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.371545 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.371708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.371856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.372024 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.372171 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.372315 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.372315 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.374950 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.375480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.375646 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.375846 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.376001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.376158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.376313 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.376481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.376636 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.376873 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.377025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.377178 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.377336 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.377493 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.377639 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.377798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.377798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.377798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.378222 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.378374 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.378533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.378688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.378887 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.379067 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.379222 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.379366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.379540 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.379686 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.379833 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.379977 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.381289 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.381639 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.381791 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.381947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.382107 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.382260 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.382415 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.382581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.382726 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.382935 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.383099 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.383251 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.383377 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.383499 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.383619 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.383741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.383861 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.383974 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.384100 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.384214 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.384325 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.384446 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.384559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.384697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.384821 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.384943 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.385057 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.385182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.385182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.385400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.385511 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.385621 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.385731 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.385851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.385963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.386073 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.386191 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.386303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.386424 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.386604 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.386732 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.386936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.387056 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.396038 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.396224 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.396376 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.396532 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.396689 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.396834 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.396986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.397141 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.397288 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.397432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.397583 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.397729 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.397872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.398035 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.398181 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.398344 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.398620 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.398795 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.399011 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.399157 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.399309 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.399453 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.399612 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.399761 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.399920 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.400080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.400240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.400914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.401316 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.401467 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.401612 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.401773 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.401939 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.402194 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.402354 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.402500 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.402645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.402645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.402645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:06:21.402645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.402645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.403394 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.403547 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.403703 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.403856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.404010 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.404170 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.404317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.404472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.404626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.404771 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.404922 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.405076 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.405248 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.406350 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.406513 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.406661 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.406818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.407004 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.407160 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.407320 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.407475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.407622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.407766 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.407920 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.408066 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.408741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.408890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.409034 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.409187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.409334 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.409489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.409646 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.409791 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.409943 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.410089 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.410233 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.410516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.413833 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.414022 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.414178 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.414328 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.414484 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.414643 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.414984 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.415138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.415292 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.415439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.415585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.415742 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.415896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.416041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.416206 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.416359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.416359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.416655 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.416802 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.416956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.417101 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.417245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.417472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.417623 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.417767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.417911 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.418070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.418227 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.418382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.418544 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.418697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.418884 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.419048 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.419194 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.419358 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.419505 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.419662 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.419806 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.419951 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.420120 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.420268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.420420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.420567 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.421268 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.421432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.421595 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.421743 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.421889 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.422041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.422194 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.422341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.422499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.422665 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.422840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.423004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.423899 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.424669 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.424827 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.424975 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.425120 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.425264 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.425416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.425562 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.425721 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.425868 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.426025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.426171 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.426325 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.426488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.426642 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.426795 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.427029 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.427176 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.427320 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.427480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.427627 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.427772 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.427927 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.428081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.428233 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.428388 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.428533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.428678 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.428830 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.428982 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.429135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.429289 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.429443 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.429594 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.429750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.429954 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.430114 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.430268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.430422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.430574 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.430718 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.430902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.431066 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.431215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.431359 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.431519 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.431664 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.431815 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.431984 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.432130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.432282 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.432428 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.432579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.432742 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.432904 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.433065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.433449 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.433993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.434153 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.434317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.434481 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.434745 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.434956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.435119 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.435271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.435434 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.435587 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.435739 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.435739 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.436011 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.436102 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.436251 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.436383 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.436516 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.436653 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.436784 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.436914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.437053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.437190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.437463 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.437598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.437728 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.437869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.438000 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.438129 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.438267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.438398 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.438529 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.438672 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.438811 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.438973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.439104 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.439242 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.439373 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.439539 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.439685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.439823 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.439954 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.440091 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.440230 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.440371 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.440502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.440640 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.440778 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.440909 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.441052 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.441190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.441328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.441458 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.441588 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.441719 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.441858 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.441988 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.442126 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.442256 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.442394 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.442524 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.442667 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.442807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.442976 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.443108 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.443237 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.443897 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.444154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.444290 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.444420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.444557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.444689 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.444933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.444933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.445196 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.445325 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.445469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.445599 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.445748 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.445880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.446010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.446147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.446286 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.446424 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.446570 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.446709 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.446858 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.446992 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.447134 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.447266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.447405 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.447536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.447666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.447803 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.447942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.448081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.448289 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.448422 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.448560 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.448691 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.448821 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.448960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.449092 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.449222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.449363 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.449494 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.449634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.449779 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.449910 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.450048 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.450188 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.450318 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.450455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.450599 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.450790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.450975 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.451106 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.451248 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.451387 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.451535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.451674 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.451804 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.451941 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.452071 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.452212 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.452342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.452480 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.452610 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.452739 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.452868 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.453007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.453138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.453277 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.453407 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.453966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.453966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.453966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.453966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.454653 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.454794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.454966 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.455208 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.455355 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.455495 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.455633 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.455772 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.455911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.456057 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.456188 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.456326 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.456458 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.456588 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.456726 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.456875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.457014 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.457152 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.457282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.457413 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.457413 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.457676 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.457816 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.457946 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.458076 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.458205 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.458343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.458485 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.458616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.458745 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.458918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.459062 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.459203 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.459342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.459473 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.459614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.459744 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.459873 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.460013 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.460157 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.460296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.460426 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.460571 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.460711 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.460850 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.460981 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.461119 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.461250 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.461389 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.461528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.461668 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.461807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.461945 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.462094 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.462232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.462381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.462522 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.462663 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.462801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.462963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.463094 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.463223 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.463361 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.463489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.464394 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.464624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.464762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.464901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.465193 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.465409 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.465555 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.465796 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.465953 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.466086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.466216 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.466356 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.466503 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.466503 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.466758 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.466975 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.466975 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.467235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.467379 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.467379 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.467626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.467764 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.467764 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.468028 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.468169 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.468300 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.468430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.468430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.468684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.468825 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.468825 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.469071 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.469201 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.469330 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.469468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.469616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.469755 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.469755 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.470009 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.470140 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.470140 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.470446 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.470588 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.471311 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.471453 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.471453 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.471721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.471866 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.471866 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.472121 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.472262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.472392 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.472522 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.472651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.472788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.472788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.473047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.473179 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.473309 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.473438 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.473438 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.473682 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.473826 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.473965 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.474536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.474536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.474910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.475053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.475053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.475310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.475453 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.475453 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.475789 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.475931 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.476070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.476209 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.476209 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.476471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.476609 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.476816 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.476957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.476957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.477211 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.477343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.477343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.477610 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.477741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.477879 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.478009 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.478009 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.478266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.478398 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.478528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.478657 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.478657 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.479216 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.479360 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.479360 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.479616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.479754 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.479885 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.480024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.480024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.480286 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.480415 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.480547 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.480677 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.480814 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.480958 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.480958 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.481212 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.481341 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.481341 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.481600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.482358 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.482503 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.482635 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.482635 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.482914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.483072 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.483072 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.483337 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.483468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.483598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.483729 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.483729 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.484068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.484633 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.484633 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.484900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.485040 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.485040 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.485306 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.485450 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.485697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.486018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.486018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.486337 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.487549 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.487549 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.487829 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.487960 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.488098 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.488237 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.488237 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.488505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.488636 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.488636 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.489128 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.489268 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.489410 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.489543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.489543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.489813 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.489955 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.489955 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.490216 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.490359 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.490491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.490621 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.490750 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.490908 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.491055 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.491195 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.491327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.491458 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.491458 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.491725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.491856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.492078 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.492212 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.492212 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.492466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.492607 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.492738 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.492876 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.492876 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.493132 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.493262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.493262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.493526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.493656 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.493794 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.493925 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.493925 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.494231 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.494811 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.495039 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.495181 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.495181 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.495438 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.495570 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.495713 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.495940 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.495940 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.496298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.496439 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.496439 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.496703 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.496849 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.496981 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.497111 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.497111 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.497368 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.497498 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.497498 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.497753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.497885 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.497885 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.498145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.498276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.498406 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.498545 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.498677 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.498817 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.498990 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.499131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.499131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.499387 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.499527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.499527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.499986 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.500132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.500263 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.500394 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.500394 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.500659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.500799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.500945 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.501343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.501343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.501619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.501762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.501762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502015 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502169 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502169 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502428 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502698 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502698 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502897 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.502987 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503169 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503169 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503333 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503436 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503436 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503704 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503797 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.503984 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.504126 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.504218 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.504304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.504397 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.504397 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.504589 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.504978 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.504978 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.505149 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.505279 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.505426 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.505578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.505720 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.505819 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.505819 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.506082 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.506184 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.506283 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.506378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.506378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.506595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.506691 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.506785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.506968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507486 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507682 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507682 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507848 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.507942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508082 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508228 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508228 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508399 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508484 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508484 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508649 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508744 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508744 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.508900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509096 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509349 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509537 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.509962 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510059 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510147 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510147 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510320 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510407 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510407 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510681 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510899 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.510899 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.511279 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.511380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.511469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.511569 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.511665 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.511755 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.511755 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.511909 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.512001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.512099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.512186 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.512186 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.512489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.512603 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.512603 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.512832 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.512942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513232 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513327 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513460 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513596 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513811 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513811 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.513976 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.514068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.514068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.514224 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.514323 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.514323 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.514480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.514572 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.514572 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.515169 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.515273 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.515273 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.515440 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.515535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.515535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.515535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.515833 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.515926 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516010 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516421 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516421 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516631 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.516948 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517039 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517039 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517245 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517339 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517339 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517339 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517789 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.517998 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518093 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518189 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518285 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518457 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518554 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518642 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518845 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.518945 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519040 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519140 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519235 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519414 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519414 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519672 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519758 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519850 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.519943 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520126 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520222 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520309 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520402 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520402 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520558 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520652 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520739 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520824 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.520917 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.521004 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.521095 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.521195 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.521345 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.521459 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.521572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.521685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.521805 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.521927 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.522023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.522154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.522249 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.522335 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.522474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.522579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.522704 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.522816 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.522955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.523076 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.523202 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.523318 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.523421 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.523509 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.523594 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.523679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.523842 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.523977 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.524097 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.524218 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.524333 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.524452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.524576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.524698 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.524811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.525025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.525297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.525417 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.525540 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.525656 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.525775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.525897 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.526017 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.526139 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.526266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.526389 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.526502 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.526623 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.526736 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.526736 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.533919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534329 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534403 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534546 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.534616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535091 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535340 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535412 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535489 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535569 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535649 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535732 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535813 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.535957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536034 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536106 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536186 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536186 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536324 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536324 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536324 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536324 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536615 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536714 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536895 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.536981 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537107 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537206 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537325 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537402 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537474 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537713 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537864 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.537959 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538045 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538119 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538191 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538269 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538419 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538500 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538817 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.538936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539025 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539105 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539345 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539417 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.539949 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540020 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540091 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540161 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540238 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540319 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540605 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540677 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540891 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.540962 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541199 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541411 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541571 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541644 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.541947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542033 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542105 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542186 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542258 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542329 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542399 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542567 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542657 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542731 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542802 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.542935 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543011 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543096 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543169 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543240 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543240 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543465 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543631 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543704 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543845 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.543924 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544005 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544085 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544230 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544300 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544388 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544461 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544538 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544617 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.544689 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.545045 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.545154 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.545249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.545341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.545553 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.545649 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.545865 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.545977 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.546173 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.546268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.546482 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.546585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.546793 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.546947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.547128 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.547221 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.547439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.547535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.547764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.547926 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.548177 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.548332 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.548464 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.548601 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.548838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.549465 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.549594 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.549723 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.549883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.550023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.550193 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.550398 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.550523 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.550713 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.550873 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.551119 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.551251 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.551434 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.551577 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.551750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.551892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.552064 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.552204 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.552373 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.552521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.552687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.552827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.552993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.553132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.553300 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.553433 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.553617 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.553762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.553916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.554057 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.554221 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.554367 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.554571 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.554718 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.554857 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.554977 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.560268 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.560379 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.560517 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.560648 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.560767 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.560894 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561013 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561115 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561204 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561560 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561813 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.561907 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562093 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562285 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562464 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562549 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562639 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562725 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.562966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563157 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563241 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563334 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563429 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563522 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563615 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563707 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.563926 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564021 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564115 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564202 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564287 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564390 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564489 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564710 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564892 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.564984 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565085 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565178 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565431 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565515 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565612 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565706 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.565890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566139 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566223 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566321 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566403 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566587 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566672 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566756 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.566971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.567194 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.567301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.567388 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.567472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.567553 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.567638 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.567776 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.567881 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568074 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568174 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568262 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568356 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568452 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568539 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568623 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568715 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568807 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.568967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.569071 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.569277 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.569371 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.569597 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.569689 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.569912 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.570013 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.570240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.570437 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.570567 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.570965 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.571087 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.571185 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.571401 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.571508 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.571679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.571781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.572042 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.572145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.572334 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.572428 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.572642 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.572751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.572964 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.573112 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.573276 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.573420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.573586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.573736 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.573893 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.574025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.574202 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.574332 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.574507 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.574633 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.574802 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.574943 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.575132 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.575252 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.575456 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.579480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.579480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.579705 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.579800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.579887 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.579980 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.580629 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.580740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.580859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.580958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581140 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581235 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581235 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581391 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581475 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581719 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.581937 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582024 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582287 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582560 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582652 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582796 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.582796 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583162 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583258 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583454 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583545 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583715 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583891 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.583978 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.584063 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.584149 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.584279 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.584378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.584465 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.584558 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.584688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.584786 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.584948 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585350 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585443 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585626 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585720 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585812 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585905 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.585999 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.586092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.586187 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.586278 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.586365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.586457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.586531 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.586665 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.586760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.586939 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.587037 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.587246 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.587390 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.587556 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.587657 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.587870 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.587999 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.588174 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.588305 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.588478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.588625 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.588782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.588947 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.589089 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.589265 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.589391 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.589578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.589679 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.589908 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.590008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.590222 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.590323 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.590534 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.590634 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.590867 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.591024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.591158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.591293 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.591462 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.591603 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.591765 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.591898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.592069 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.592516 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.592646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.592646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.592954 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.593107 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.593273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.593405 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.593533 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.593669 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.593828 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.593976 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.594128 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.594275 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.594458 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.594591 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.594790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.594975 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.595130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.595270 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.595454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.595586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.596326 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.596462 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.596655 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.596822 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.597001 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.597141 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.597280 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 09:06:21.597417 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.597636 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.597952 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.598261 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.598596 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.598933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.599275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.599563 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.599874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.600184 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.600496 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.600824 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.601148 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.601472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.601782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.602100 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.602423 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.602737 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.603072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.603401 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.603711 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.604276 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.604589 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.604899 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.605208 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.605523 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.605838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.606164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.606490 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.606802 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.607147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.607474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.607821 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.611874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.611874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.611874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.611874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.611874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.611874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:06:21.611874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 09:06:21.660639 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO dbcounter [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Registered counter for database nova_api Jun 22 09:06:21.672420 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO dbcounter [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Registered counter for database nova_api Jun 22 09:06:21.680652 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_db.sqlalchemy.engines [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:06:21.687415 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writer thread running {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:06:21.692270 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:06:21.698876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writer thread running {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:06:21.744198 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.context [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb77ed2-4ccd-4224-9035-066f22604e48(cell1) {{(pid=118267) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 09:06:21.748319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.749868 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.750672 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.752688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.754588 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.context [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb77ed2-4ccd-4224-9035-066f22604e48(cell1) {{(pid=118268) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 09:06:21.754716 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO dbcounter [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Registered counter for database nova_cell0 Jun 22 09:06:21.758633 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO dbcounter [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Registered counter for database nova_cell1 Jun 22 09:06:21.758752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.760226 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.761019 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.762972 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.765001 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO dbcounter [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Registered counter for database nova_cell0 Jun 22 09:06:21.765909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_db.sqlalchemy.engines [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:06:21.768541 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_db.sqlalchemy.engines [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:06:21.769605 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO dbcounter [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Registered counter for database nova_cell1 Jun 22 09:06:21.775179 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writer thread running {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:06:21.776820 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:06:21.777878 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writer thread running {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:06:21.778949 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:06:21.784487 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writer thread running {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:06:21.787115 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writer thread running {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:06:21.924470 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO dbcounter [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Registered counter for database nova_cell0 Jun 22 09:06:21.931090 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_db.sqlalchemy.engines [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:06:21.932285 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO dbcounter [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Registered counter for database nova_cell0 Jun 22 09:06:21.935347 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writer thread running {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:06:21.938805 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:06:21.943643 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writer thread running {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:06:22.255397 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: WARNING keystonemiddleware.auth_token [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 09:06:22.262067 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: WARNING keystonemiddleware.auth_token [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 09:06:22.269945 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: WARNING keystonemiddleware.auth_token [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 09:06:22.271294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: WARNING keystonemiddleware.auth_token [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 09:06:22.618790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: WARNING keystonemiddleware.auth_token [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 09:06:22.624916 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: WARNING keystonemiddleware.auth_token [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 09:06:22.625317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: WARNING keystonemiddleware.auth_token [None req-e0a67528-ba1b-4410-8cf2-2e5ebbe55ba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 09:06:22.631328 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653458e39c0 pid: 118268 (default app) Jun 22 09:06:22.631719 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: WARNING keystonemiddleware.auth_token [None req-8a92a251-975f-4806-899d-dcb3b00a873a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 09:06:22.637042 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653458e39c0 pid: 118267 (default app) Jun 22 09:07:03.369331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=3 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:03.370177 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=3 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:03.370935 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=3 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:03.371876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=3 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:04.615368 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fe8dd9a0-25f6-426f-b4e1-ad4f50e987a6 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Action: 'create', calling method: .version_select at 0x7f50103b9700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1474995802"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:06.995325 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fe8dd9a0-25f6-426f-b4e1-ad4f50e987a6 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.645588 Jun 22 09:07:07.003004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1154 bytes} [Wed Jun 22 09:07:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3648 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 09:07:07.010422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=3 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:07.011235 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=3 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:07.011994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=3 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:07.012958 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=3 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:07.614761 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-602414c4-a482-42fb-9194-bf51e68e23c8 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f50104041f0>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:08.327091 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-602414c4-a482-42fb-9194-bf51e68e23c8 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712" status: 200 len: 346 microversion: 2.1 time: 1.321705 Jun 22 09:07:08.335195 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 1/2] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:07:07 2022] GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712 => generated 346 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:08.341884 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d6899c54-470a-4ce8-89d5-dec6b9918012 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Action: 'create', calling method: .version_select at 0x7f50102804c0>, body: {"snapshot": {"volume_id": "2f30812b-345c-45c9-96f7-2c770fa13712", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-615263119"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:09.015154 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d6899c54-470a-4ce8-89d5-dec6b9918012 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.678823 Jun 22 09:07:09.016035 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1161 bytes} [Wed Jun 22 09:07:08 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:09.028705 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8f49306e-cd10-42f3-9f8e-13c5dfc93b47 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f50102cb670>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:09.066745 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8f49306e-cd10-42f3-9f8e-13c5dfc93b47 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0" status: 200 len: 286 microversion: 2.1 time: 0.044238 Jun 22 09:07:09.067562 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 22 09:07:09 2022] GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:09.085878 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9c035f9c-592e-43fc-ad59-2c6306eb11ec tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f5010280550>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:09.126985 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9c035f9c-592e-43fc-ad59-2c6306eb11ec tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.053334 Jun 22 09:07:09.127918 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 3/5] 10.222.0.55 () {58 vars in 1139 bytes} [Wed Jun 22 09:07:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:09.140642 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-dd374956-6dd5-4a25-9a7d-4b1908e503bd tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f50102cbca0>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:09.177168 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-dd374956-6dd5-4a25-9a7d-4b1908e503bd tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0" status: 200 len: 286 microversion: 2.1 time: 0.041781 Jun 22 09:07:09.181834 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 3/6] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 22 09:07:09 2022] GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:10.190497 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-da18eea4-c8ec-407c-b844-c8a253d540b4 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f5010217310>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:10.740513 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-da18eea4-c8ec-407c-b844-c8a253d540b4 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0" status: 200 len: 286 microversion: 2.1 time: 0.555232 Jun 22 09:07:10.761992 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 22 09:07:10 2022] GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0 => generated 286 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:07:11.760189 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f616be51-decf-497b-8bf3-a98c3487e9ae tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f50102cbe50>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:12.302632 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f616be51-decf-497b-8bf3-a98c3487e9ae tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0" status: 200 len: 286 microversion: 2.1 time: 0.546191 Jun 22 09:07:12.303261 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 22 09:07:11 2022] GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0 => generated 286 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:13.314517 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-940f7bde-a219-4c37-bd93-6ceda33063ae tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f5010217a60>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:13.512890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-940f7bde-a219-4c37-bd93-6ceda33063ae tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0" status: 200 len: 287 microversion: 2.1 time: 0.202691 Jun 22 09:07:13.523694 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 5/9] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 22 09:07:13 2022] GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0 => generated 287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:13.525184 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-613ee48f-683f-48db-926a-53d55ca0b75e tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f50102cb700>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:13.740686 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-613ee48f-683f-48db-926a-53d55ca0b75e tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0" status: 202 len: 0 microversion: 2.1 time: 0.220254 Jun 22 09:07:13.751199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 5/10] 10.222.0.55 () {58 vars in 1253 bytes} [Wed Jun 22 09:07:13 2022] DELETE /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:07:13.751420 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-67e224b4-a125-459b-96e7-02cd8ff67451 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f5010280430>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:13.829163 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-67e224b4-a125-459b-96e7-02cd8ff67451 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0" status: 200 len: 286 microversion: 2.1 time: 0.082850 Jun 22 09:07:13.831192 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 6/11] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 22 09:07:13 2022] GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:14.845887 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bd1215a1-e9c7-46ad-8534-382497d3c939 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f501027c430>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:14.886382 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-bd1215a1-e9c7-46ad-8534-382497d3c939 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] HTTP exception thrown: Snapshot 4954cbdd-7817-4daa-ab7c-2eb38380def0 could not be found. Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bd1215a1-e9c7-46ad-8534-382497d3c939 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Request method failure captured: Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0 HTTP/1.1 Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistu3X-Jaaztj44M5FjwPBUcpuBi0UMAYLDasT7uhFYLELfV4nlwehUsiggRmW-Ukepb6hLtbt3bt0AKKMiNh-_FuwH9-xmHfU_r6_vP_v03bzL9qfOG6haw6Vgzmdy9Jy_VlsVubJt-sOu0LcK5zxesf5LsYPM7j9vhkKKFlpxwFqnQ Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: e45cee7cefba4c77a5f2f97769686105 Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:07:14.891276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e45cee7cefba4c77a5f2f97769686105"}]}] Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: e45cee7cefba4c77a5f2f97769686105 Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-VolumesSnapshotsTestJSON-27088877-project Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: d3e65b6545344a8fa585ec4720bdafb6 Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-27088877-project Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Snapshot 4954cbdd-7817-4daa-ab7c-2eb38380def0 could not be found. Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '4954cbdd-7817-4daa-ab7c-2eb38380def0'} Jun 22 09:07:14.892497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4954cbdd-7817-4daa-ab7c-2eb38380def0 could not be found. (HTTP 404) (Request-ID: req-60a31306-b7ba-49f5-a9ba-40860ce87298) Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:14.893135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:07:14.893973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4954cbdd-7817-4daa-ab7c-2eb38380def0 could not be found. Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 09:07:14.894915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4954cbdd-7817-4daa-ab7c-2eb38380def0 could not be found. Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4954cbdd-7817-4daa-ab7c-2eb38380def0 could not be found. Jun 22 09:07:14.895932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:14.907132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bd1215a1-e9c7-46ad-8534-382497d3c939 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Returning 404 to user: Snapshot 4954cbdd-7817-4daa-ab7c-2eb38380def0 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:14.908199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bd1215a1-e9c7-46ad-8534-382497d3c939 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0" status: 404 len: 111 microversion: 2.1 time: 0.066663 Jun 22 09:07:14.913708 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 22 09:07:14 2022] GET /compute/v2.1/os-snapshots/4954cbdd-7817-4daa-ab7c-2eb38380def0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:14.920836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5b7e249a-f621-4e46-b672-2a476627459a tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f5010280c10>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:15.228675 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5b7e249a-f621-4e46-b672-2a476627459a tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712" status: 202 len: 0 microversion: 2.1 time: 0.311470 Jun 22 09:07:15.229761 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:07:14 2022] DELETE /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:07:15.245850 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b5a9380f-1cad-4aec-94fb-475dd3c332f7 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f501027ce50>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:15.378783 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b5a9380f-1cad-4aec-94fb-475dd3c332f7 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712" status: 200 len: 345 microversion: 2.1 time: 0.144787 Jun 22 09:07:15.383900 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 7/14] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:07:15 2022] GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712 => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:16.392379 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-083cd1bc-f3ef-48b2-9cba-ed6667b2faa3 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f50102179d0>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:16.455855 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-083cd1bc-f3ef-48b2-9cba-ed6667b2faa3 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] HTTP exception thrown: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-083cd1bc-f3ef-48b2-9cba-ed6667b2faa3 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Request method failure captured: Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712 HTTP/1.1 Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistu3X-Jaaztj44M5FjwPBUcpuBi0UMAYLDasT7uhFYLELfV4nlwehUsiggRmW-Ukepb6hLtbt3bt0AKKMiNh-_FuwH9-xmHfU_r6_vP_v03bzL9qfOG6haw6Vgzmdy9Jy_VlsVubJt-sOu0LcK5zxesf5LsYPM7j9vhkKKFlpxwFqnQ Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: e45cee7cefba4c77a5f2f97769686105 Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:07:16.460947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e45cee7cefba4c77a5f2f97769686105"}]}] Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: e45cee7cefba4c77a5f2f97769686105 Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesSnapshotsTestJSON-27088877-project Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: d3e65b6545344a8fa585ec4720bdafb6 Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesSnapshotsTestJSON-27088877-project Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '2f30812b-345c-45c9-96f7-2c770fa13712'} Jun 22 09:07:16.462005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. (HTTP 404) (Request-ID: req-ed5b12e5-5117-42cb-8582-a64366fa4903) Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:16.462716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:07:16.463626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:07:16.464498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-083cd1bc-f3ef-48b2-9cba-ed6667b2faa3 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Returning 404 to user: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-083cd1bc-f3ef-48b2-9cba-ed6667b2faa3 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712" status: 404 len: 109 microversion: 2.1 time: 0.076051 Jun 22 09:07:16.465354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 8/15] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:07:16 2022] GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:16.481073 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8a71938f-7c4f-401f-988e-93a11b970bb9 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f50101ef550>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:16.538306 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-8a71938f-7c4f-401f-988e-93a11b970bb9 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] HTTP exception thrown: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8a71938f-7c4f-401f-988e-93a11b970bb9 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Request method failure captured: Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712 HTTP/1.1 Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistu3X-Jaaztj44M5FjwPBUcpuBi0UMAYLDasT7uhFYLELfV4nlwehUsiggRmW-Ukepb6hLtbt3bt0AKKMiNh-_FuwH9-xmHfU_r6_vP_v03bzL9qfOG6haw6Vgzmdy9Jy_VlsVubJt-sOu0LcK5zxesf5LsYPM7j9vhkKKFlpxwFqnQ Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: e45cee7cefba4c77a5f2f97769686105 Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:07:16.541448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e45cee7cefba4c77a5f2f97769686105"}]}] Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: e45cee7cefba4c77a5f2f97769686105 Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-VolumesSnapshotsTestJSON-27088877-project Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: d3e65b6545344a8fa585ec4720bdafb6 Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-27088877-project Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '2f30812b-345c-45c9-96f7-2c770fa13712'} Jun 22 09:07:16.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. (HTTP 404) (Request-ID: req-c14bf433-1c27-4379-9664-9928ce5b0a63) Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:16.543502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:07:16.544466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 09:07:16.545995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8a71938f-7c4f-401f-988e-93a11b970bb9 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Returning 404 to user: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:16.548385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8a71938f-7c4f-401f-988e-93a11b970bb9 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712" status: 404 len: 109 microversion: 2.1 time: 0.068987 Jun 22 09:07:16.568423 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-78d3dfce-61ff-429c-b344-64968c56cd06 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Calling method '.version_select at 0x7f50102170d0>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:16.572522 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:07:16 2022] DELETE /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:16.624642 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-78d3dfce-61ff-429c-b344-64968c56cd06 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] HTTP exception thrown: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-78d3dfce-61ff-429c-b344-64968c56cd06 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Request method failure captured: Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712 HTTP/1.1 Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistu3X-Jaaztj44M5FjwPBUcpuBi0UMAYLDasT7uhFYLELfV4nlwehUsiggRmW-Ukepb6hLtbt3bt0AKKMiNh-_FuwH9-xmHfU_r6_vP_v03bzL9qfOG6haw6Vgzmdy9Jy_VlsVubJt-sOu0LcK5zxesf5LsYPM7j9vhkKKFlpxwFqnQ Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: e45cee7cefba4c77a5f2f97769686105 Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:07:16.628612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e45cee7cefba4c77a5f2f97769686105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e45cee7cefba4c77a5f2f97769686105"}]}] Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: e45cee7cefba4c77a5f2f97769686105 Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-27088877 Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesSnapshotsTestJSON-27088877-project Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: d3e65b6545344a8fa585ec4720bdafb6 Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesSnapshotsTestJSON-27088877-project Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '2f30812b-345c-45c9-96f7-2c770fa13712'} Jun 22 09:07:16.629751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. (HTTP 404) (Request-ID: req-3f565c3e-2c93-4b6c-bbef-c543579da8e9) Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:16.630457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:07:16.631790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:07:16.632721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. Jun 22 09:07:16.633619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:07:16.636708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-78d3dfce-61ff-429c-b344-64968c56cd06 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] Returning 404 to user: Volume 2f30812b-345c-45c9-96f7-2c770fa13712 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:16.637824 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-78d3dfce-61ff-429c-b344-64968c56cd06 tempest-VolumesSnapshotsTestJSON-27088877 tempest-VolumesSnapshotsTestJSON-27088877-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712" status: 404 len: 109 microversion: 2.1 time: 0.087737 Jun 22 09:07:16.638914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 9/17] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:07:16 2022] GET /compute/v2.1/os-volumes/2f30812b-345c-45c9-96f7-2c770fa13712 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:17.757290 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fb406fab-ff2f-4466-9ee3-f722645eb0cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'create', calling method: .version_select at 0x7f50101ef280>, body: {"keypair": {"name": "tempest-keypair-949014270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuJS4k/IXsxdOplxnI0OH0VnW+0Y995hfUAcclZnSgrQkqV5do/LV9TZ8qPnnOTniel+wLlquovEGcwMNbIr2bS9g+ez9FfGGInUz7Oyl72SZOPQ5a+YBDlbPwceV6y9A=="}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:17.909005 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-fb406fab-ff2f-4466-9ee3-f722645eb0cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Getting quotas for project b887d876b7624299b5575036da211d6b. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:07:17.923337 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-fb406fab-ff2f-4466-9ee3-f722645eb0cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Getting quotas for user abcbf501ca754212a16bbfbb901944f7 and project b887d876b7624299b5575036da211d6b. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:07:18.098794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fb406fab-ff2f-4466-9ee3-f722645eb0cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.925026 Jun 22 09:07:18.106163 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 9/18] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:07:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:19.744410 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-805a2dae-cd03-4c4f-9c45-c85d200a14d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: .version_select at 0x7f5010be3940>, body: {"keypair": {"name": "tempest-keypair-720572273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZHJ5jWz5Jh8X5bRHCxM8CFe9p5P6xyPPV801YaKHzdjJg4ngjgeibeuNMC5qZsUp74qWZ31n/eD6TB5DPAKaatBdHOWmpn48W3BDfHqhh4bSZSH1aHvpjJxQ0SoW7EPg=="}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:19.818070 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1662334497", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:19.916530 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-805a2dae-cd03-4c4f-9c45-c85d200a14d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'key_pairs'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:07:19.948245 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-805a2dae-cd03-4c4f-9c45-c85d200a14d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for user 0673a8903f56430f86f87b9447668300 and project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'key_pairs'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:07:19.977024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] validate_networks() for [('b36bc90f-3b6b-474d-8af3-dd7768321d61', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:07:20.220298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-805a2dae-cd03-4c4f-9c45-c85d200a14d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.951312 Jun 22 09:07:20.222144 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 10/19] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:07:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:22.189839 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:07:22.190400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:07:22.191144 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:07:22.192337 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:07:22.192999 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:07:22.218016 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:22.225879 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:22.229330 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:22.229886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:22.306106 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Getting quotas for project aa1c1626dad34ae9a2216e46ffae4003. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:07:22.313458 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Getting quotas for user 71ac6423996b4e5d906de9ff6986fb03 and project aa1c1626dad34ae9a2216e46ffae4003. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:07:22.335942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:07:22.351844 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:07:22.400816 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1055372374", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "networks": [{"uuid": "38012433-cd82-4c62-9189-d8a4ad0d5908"}]}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:22.585960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] validate_networks() for [('38012433-cd82-4c62-9189-d8a4ad0d5908', None, None, None, None, None)] {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:07:22.586100 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c102248d-5640-4cff-8b08-6efcae167516 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.871496 Jun 22 09:07:22.586695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 10/20] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:07:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:07:22.597558 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f357a349-7194-4df7-9570-743e6bfb76e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:22.598385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f357a349-7194-4df7-9570-743e6bfb76e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:23.041380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f357a349-7194-4df7-9570-743e6bfb76e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:23.074695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f357a349-7194-4df7-9570-743e6bfb76e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1222 microversion: 2.1 time: 0.481262 Jun 22 09:07:23.087674 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 11/21] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:22 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1222 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:23.370109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1928228738", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:23.571669 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] validate_networks() for [('b36bc90f-3b6b-474d-8af3-dd7768321d61', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:07:25.387606 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:07:25.391051 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:07:25.391051 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:07:25.391051 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:07:25.391051 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:07:25.401613 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:25.402212 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:25.403187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:25.403707 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:25.442359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Getting quotas for project e06efd9f018749e3931f713b485d6f84. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:07:25.448105 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Getting quotas for user 0a8cc558dee74179b538f20c1b90f44c and project e06efd9f018749e3931f713b485d6f84. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:07:25.461042 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:07:25.464566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:07:25.655848 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-06b5291e-98f6-4b51-880c-e545db5af56a tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.970709 Jun 22 09:07:25.659366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 11/22] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:07:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:07:25.674495 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-dfb4e66b-b674-490e-9934-eaa22d360827 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:25.678206 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-dfb4e66b-b674-490e-9934-eaa22d360827 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:25.890380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:07:25.890380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:07:25.890380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:07:25.890380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:07:25.890380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:07:25.916028 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:25.919035 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:25.924836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:25.924836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:25.965549 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-dfb4e66b-b674-490e-9934-eaa22d360827 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:25.992717 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-dfb4e66b-b674-490e-9934-eaa22d360827 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1215 microversion: 2.1 time: 0.325220 Jun 22 09:07:25.995133 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Getting quotas for project aa1c1626dad34ae9a2216e46ffae4003. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:07:26.000908 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Getting quotas for user 71ac6423996b4e5d906de9ff6986fb03 and project aa1c1626dad34ae9a2216e46ffae4003. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:07:26.005441 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 12/23] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:25 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1215 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:26.033303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:07:26.039318 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:07:26.206859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a6a974bb-b688-4503-833a-4b0c9518edd8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.843908 Jun 22 09:07:26.221679 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-158e5d1d-8c5d-4627-b392-e292434d617f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:26.221827 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 12/24] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:07:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:07:26.221913 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-158e5d1d-8c5d-4627-b392-e292434d617f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:26.487191 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-158e5d1d-8c5d-4627-b392-e292434d617f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:26.497217 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-158e5d1d-8c5d-4627-b392-e292434d617f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1222 microversion: 2.1 time: 0.283477 Jun 22 09:07:26.500261 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 13/25] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:26 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1222 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:26.757538 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-656956148", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afe5cf3e-c89f-4784-88a7-346190bc1b68"}], "security_groups": [{"name": "tempest-securitygroup--1973141145"}], "key_name": "tempest-keypair-949014270", "user_data": "}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:27.013419 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-08669ea8-6bdd-48d8-8e7b-9fb8b6d4a730 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:27.013975 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] validate_networks() for [('afe5cf3e-c89f-4784-88a7-346190bc1b68', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:07:27.014448 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-08669ea8-6bdd-48d8-8e7b-9fb8b6d4a730 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:27.118895 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-08669ea8-6bdd-48d8-8e7b-9fb8b6d4a730 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:27.130588 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-08669ea8-6bdd-48d8-8e7b-9fb8b6d4a730 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1215 microversion: 2.1 time: 0.123030 Jun 22 09:07:27.139145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 14/26] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:27 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:27.531589 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d50b3c03-dac4-4242-9557-4ea76323bd4a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:27.533572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d50b3c03-dac4-4242-9557-4ea76323bd4a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:27.680411 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d50b3c03-dac4-4242-9557-4ea76323bd4a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:27.702564 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d50b3c03-dac4-4242-9557-4ea76323bd4a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1222 microversion: 2.1 time: 0.187364 Jun 22 09:07:27.705122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 15/27] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:27 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1222 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:27.803966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:07:27.803966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:07:27.803966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:07:27.803966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:07:27.803966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:07:27.830199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:27.831075 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:27.833602 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:27.835401 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:27.885001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Getting quotas for project b887d876b7624299b5575036da211d6b. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:07:27.907906 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Getting quotas for user abcbf501ca754212a16bbfbb901944f7 and project b887d876b7624299b5575036da211d6b. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:07:27.946130 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:07:27.948391 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:07:28.153738 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cbe33f9c-0a7f-4c0d-83ba-31eb959ebd97 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:28.154253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cbe33f9c-0a7f-4c0d-83ba-31eb959ebd97 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:28.182909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-31a37f5c-86ae-4f48-abb2-373a3084596f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.429288 Jun 22 09:07:28.187928 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 13/28] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:07:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:07:28.199699 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-527a3b91-4629-4e7d-abf0-bdb400849c9d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:28.201171 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-527a3b91-4629-4e7d-abf0-bdb400849c9d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:28.271307 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cbe33f9c-0a7f-4c0d-83ba-31eb959ebd97 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:28.278663 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cbe33f9c-0a7f-4c0d-83ba-31eb959ebd97 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1215 microversion: 2.1 time: 0.128863 Jun 22 09:07:28.291342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 16/29] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:28 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:28.422666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-527a3b91-4629-4e7d-abf0-bdb400849c9d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:28.431172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-527a3b91-4629-4e7d-abf0-bdb400849c9d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1236 microversion: 2.1 time: 0.237553 Jun 22 09:07:28.432277 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 14/30] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:28 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1236 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:28.737872 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f57cb3fd-3849-4238-bd09-50b7b64b1e97 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:28.738483 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f57cb3fd-3849-4238-bd09-50b7b64b1e97 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:28.786105 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1835271947", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "feb2a623-753e-4717-8e5a-c83201989599"}], "security_groups": [{"name": "tempest-securitygroup--188405311"}], "key_name": "tempest-keypair-720572273", "user_data": "}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:28.792621 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f57cb3fd-3849-4238-bd09-50b7b64b1e97 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:28.799883 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f57cb3fd-3849-4238-bd09-50b7b64b1e97 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:28.808592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f57cb3fd-3849-4238-bd09-50b7b64b1e97 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:28.817002 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f57cb3fd-3849-4238-bd09-50b7b64b1e97 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:29.227601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f57cb3fd-3849-4238-bd09-50b7b64b1e97 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:29.244521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f57cb3fd-3849-4238-bd09-50b7b64b1e97 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1274 microversion: 2.1 time: 0.522496 Jun 22 09:07:29.246708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 17/31] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:28 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1274 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:29.303752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b9b67f1c-5f40-4df8-b561-ffa260b98584 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:29.304303 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b9b67f1c-5f40-4df8-b561-ffa260b98584 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:29.333931 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b9b67f1c-5f40-4df8-b561-ffa260b98584 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:29.334804 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b9b67f1c-5f40-4df8-b561-ffa260b98584 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:29.338057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b9b67f1c-5f40-4df8-b561-ffa260b98584 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:29.340312 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b9b67f1c-5f40-4df8-b561-ffa260b98584 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:29.492679 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b9b67f1c-5f40-4df8-b561-ffa260b98584 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:29.508359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b9b67f1c-5f40-4df8-b561-ffa260b98584 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1211 microversion: 2.1 time: 0.210583 Jun 22 09:07:29.510050 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 18/32] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:29 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1211 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:29.568592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4790df3a-be70-4664-b430-983742b5396b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:29.569215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4790df3a-be70-4664-b430-983742b5396b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:29.603640 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] validate_networks() for [('feb2a623-753e-4717-8e5a-c83201989599', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:07:29.769366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4790df3a-be70-4664-b430-983742b5396b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:29.781029 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4790df3a-be70-4664-b430-983742b5396b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1236 microversion: 2.1 time: 0.266201 Jun 22 09:07:29.784614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 19/33] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:29 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1236 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:30.264824 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4d432e2d-a044-45e0-9337-387b54de1570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:30.266346 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4d432e2d-a044-45e0-9337-387b54de1570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:30.279337 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4d432e2d-a044-45e0-9337-387b54de1570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:30.282482 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4d432e2d-a044-45e0-9337-387b54de1570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:30.285564 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4d432e2d-a044-45e0-9337-387b54de1570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:30.287674 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4d432e2d-a044-45e0-9337-387b54de1570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:30.617328 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4d432e2d-a044-45e0-9337-387b54de1570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:30.637237 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4d432e2d-a044-45e0-9337-387b54de1570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1280 microversion: 2.1 time: 0.377872 Jun 22 09:07:30.648638 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 20/34] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:30 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1280 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:30.655363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-adead874-33ea-47aa-95cc-21eae7399636 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:30.658273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-adead874-33ea-47aa-95cc-21eae7399636 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:30.676090 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-adead874-33ea-47aa-95cc-21eae7399636 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:30.688932 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-adead874-33ea-47aa-95cc-21eae7399636 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:30.689794 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-adead874-33ea-47aa-95cc-21eae7399636 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:30.690254 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-adead874-33ea-47aa-95cc-21eae7399636 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:30.830103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-adead874-33ea-47aa-95cc-21eae7399636 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:30.838065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-adead874-33ea-47aa-95cc-21eae7399636 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1275 microversion: 2.1 time: 0.187454 Jun 22 09:07:30.839045 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 21/35] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:30 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:30.857167 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-36aabc87-c0a6-44fa-a590-02ce86ae13e3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:30.861073 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-36aabc87-c0a6-44fa-a590-02ce86ae13e3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:30.875140 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-36aabc87-c0a6-44fa-a590-02ce86ae13e3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:30.875592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-36aabc87-c0a6-44fa-a590-02ce86ae13e3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:30.878253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-36aabc87-c0a6-44fa-a590-02ce86ae13e3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:30.880491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-36aabc87-c0a6-44fa-a590-02ce86ae13e3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:31.655375 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-36aabc87-c0a6-44fa-a590-02ce86ae13e3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:31.668613 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-36aabc87-c0a6-44fa-a590-02ce86ae13e3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1232 microversion: 2.1 time: 0.828164 Jun 22 09:07:31.670966 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 22/36] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:30 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1232 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:31.691414 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ccd6ff9e-0636-4a8a-8349-90f90ce5000f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:31.707499 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ccd6ff9e-0636-4a8a-8349-90f90ce5000f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:31.738047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ccd6ff9e-0636-4a8a-8349-90f90ce5000f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:31.738847 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ccd6ff9e-0636-4a8a-8349-90f90ce5000f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:31.759236 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ccd6ff9e-0636-4a8a-8349-90f90ce5000f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:31.760096 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ccd6ff9e-0636-4a8a-8349-90f90ce5000f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:32.301025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:07:32.302726 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:07:32.303800 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:07:32.304362 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:07:32.305010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:07:32.323495 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:32.327588 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:32.328946 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:32.333986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:32.352506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ccd6ff9e-0636-4a8a-8349-90f90ce5000f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:32.362266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ccd6ff9e-0636-4a8a-8349-90f90ce5000f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1280 microversion: 2.1 time: 0.678458 Jun 22 09:07:32.366956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 23/37] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:31 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1280 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:32.382118 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8520a4da-8495-4388-bda0-bc69de653025 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:32.383004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8520a4da-8495-4388-bda0-bc69de653025 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:32.400912 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8520a4da-8495-4388-bda0-bc69de653025 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:32.401911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8520a4da-8495-4388-bda0-bc69de653025 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:32.402933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8520a4da-8495-4388-bda0-bc69de653025 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:32.410496 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8520a4da-8495-4388-bda0-bc69de653025 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:32.424721 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:07:32.441167 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for user 0673a8903f56430f86f87b9447668300 and project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:07:32.474055 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:07:32.483309 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:07:32.623766 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8520a4da-8495-4388-bda0-bc69de653025 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:32.639316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8520a4da-8495-4388-bda0-bc69de653025 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1273 microversion: 2.1 time: 0.270157 Jun 22 09:07:32.642084 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 24/38] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:32 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:32.689573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f5116d5e-b8fc-41b1-9b48-a20975084225 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:32.690916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f5116d5e-b8fc-41b1-9b48-a20975084225 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:32.714659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f5116d5e-b8fc-41b1-9b48-a20975084225 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:32.716182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f5116d5e-b8fc-41b1-9b48-a20975084225 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:32.718428 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f5116d5e-b8fc-41b1-9b48-a20975084225 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:32.723010 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f5116d5e-b8fc-41b1-9b48-a20975084225 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:32.764483 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2d33e60c-eb88-439e-87e8-7bef66db8f91 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.983929 Jun 22 09:07:32.783126 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 15/39] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:07:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 3995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:07:32.811786 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-69585b7b-e66c-433f-a3d8-ccb22bf5f4b2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:32.814475 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-69585b7b-e66c-433f-a3d8-ccb22bf5f4b2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:32.975450 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f5116d5e-b8fc-41b1-9b48-a20975084225 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:32.989276 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f5116d5e-b8fc-41b1-9b48-a20975084225 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1294 microversion: 2.1 time: 0.305109 Jun 22 09:07:32.990525 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 25/40] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:32 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1294 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:33.204244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-69585b7b-e66c-433f-a3d8-ccb22bf5f4b2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:33.204244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-69585b7b-e66c-433f-a3d8-ccb22bf5f4b2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1241 microversion: 2.1 time: 0.370786 Jun 22 09:07:33.204244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 16/41] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:32 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1241 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:33.385389 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c74afacb-47ac-48ca-b21a-82b238769e8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:33.385389 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c74afacb-47ac-48ca-b21a-82b238769e8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:33.392674 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c74afacb-47ac-48ca-b21a-82b238769e8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:33.393141 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c74afacb-47ac-48ca-b21a-82b238769e8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:33.393943 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c74afacb-47ac-48ca-b21a-82b238769e8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:33.394388 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c74afacb-47ac-48ca-b21a-82b238769e8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:33.664792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4009e36e-cda1-466b-b08a-273424028359 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:33.664792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4009e36e-cda1-466b-b08a-273424028359 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:33.679872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4009e36e-cda1-466b-b08a-273424028359 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:33.682014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4009e36e-cda1-466b-b08a-273424028359 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:33.683903 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4009e36e-cda1-466b-b08a-273424028359 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:33.687044 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4009e36e-cda1-466b-b08a-273424028359 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:33.722038 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c74afacb-47ac-48ca-b21a-82b238769e8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:33.733924 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c74afacb-47ac-48ca-b21a-82b238769e8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1280 microversion: 2.1 time: 0.354131 Jun 22 09:07:33.737563 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 26/42] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:33 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1280 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:34.016691 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6ea772b9-4a9d-4a07-bf55-754556300c73 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:34.017328 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6ea772b9-4a9d-4a07-bf55-754556300c73 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:34.066176 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ea772b9-4a9d-4a07-bf55-754556300c73 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:34.077874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ea772b9-4a9d-4a07-bf55-754556300c73 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:34.078917 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ea772b9-4a9d-4a07-bf55-754556300c73 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:34.079394 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ea772b9-4a9d-4a07-bf55-754556300c73 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:34.309092 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4009e36e-cda1-466b-b08a-273424028359 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:34.342376 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4009e36e-cda1-466b-b08a-273424028359 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1273 microversion: 2.1 time: 0.688352 Jun 22 09:07:34.356849 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 17/43] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:33 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1273 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:34.402904 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fdab4272-b573-4b72-82bf-9b52dfbfa10b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:34.402904 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fdab4272-b573-4b72-82bf-9b52dfbfa10b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:34.662871 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6ea772b9-4a9d-4a07-bf55-754556300c73 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:34.676181 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6ea772b9-4a9d-4a07-bf55-754556300c73 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1294 microversion: 2.1 time: 0.667969 Jun 22 09:07:34.678075 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 27/44] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:34 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1294 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:34.752683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6f4cc459-031d-4f47-9f06-50bdad374ea2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:34.753312 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6f4cc459-031d-4f47-9f06-50bdad374ea2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:34.772313 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6f4cc459-031d-4f47-9f06-50bdad374ea2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:34.772628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6f4cc459-031d-4f47-9f06-50bdad374ea2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:34.782147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6f4cc459-031d-4f47-9f06-50bdad374ea2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:34.783700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6f4cc459-031d-4f47-9f06-50bdad374ea2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:35.170476 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fdab4272-b573-4b72-82bf-9b52dfbfa10b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:35.182912 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fdab4272-b573-4b72-82bf-9b52dfbfa10b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1241 microversion: 2.1 time: 0.808347 Jun 22 09:07:35.186733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 18/45] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:34 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1241 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:35.395698 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-31a29ab8-1003-49ef-a23e-a8c5a20eb8db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:35.395698 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-31a29ab8-1003-49ef-a23e-a8c5a20eb8db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:35.395698 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:35.395698 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31a29ab8-1003-49ef-a23e-a8c5a20eb8db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:35.395698 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31a29ab8-1003-49ef-a23e-a8c5a20eb8db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:35.396272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31a29ab8-1003-49ef-a23e-a8c5a20eb8db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:35.396272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31a29ab8-1003-49ef-a23e-a8c5a20eb8db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:35.427248 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:35.604670 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6f4cc459-031d-4f47-9f06-50bdad374ea2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:35.615103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6f4cc459-031d-4f47-9f06-50bdad374ea2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.867033 Jun 22 09:07:35.618028 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 28/46] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:34 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:35.697064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4f96a741-4a4a-46bc-bd25-1bd021e5b3dd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:35.698420 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4f96a741-4a4a-46bc-bd25-1bd021e5b3dd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:35.712540 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f96a741-4a4a-46bc-bd25-1bd021e5b3dd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:35.714165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f96a741-4a4a-46bc-bd25-1bd021e5b3dd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:35.717903 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f96a741-4a4a-46bc-bd25-1bd021e5b3dd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:35.718618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f96a741-4a4a-46bc-bd25-1bd021e5b3dd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:35.933770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4f96a741-4a4a-46bc-bd25-1bd021e5b3dd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:35.948447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4f96a741-4a4a-46bc-bd25-1bd021e5b3dd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.252574 Jun 22 09:07:35.954406 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 29/47] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:35 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:35.991248 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-31a29ab8-1003-49ef-a23e-a8c5a20eb8db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:35.999078 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-31a29ab8-1003-49ef-a23e-a8c5a20eb8db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.643152 Jun 22 09:07:36.000037 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 19/48] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:35 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:36.204487 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fd8da090-f62e-42b1-9327-748236b8cf28 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:36.205109 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-fd8da090-f62e-42b1-9327-748236b8cf28 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:36.212046 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fd8da090-f62e-42b1-9327-748236b8cf28 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:36.219064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fd8da090-f62e-42b1-9327-748236b8cf28 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:36.219064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fd8da090-f62e-42b1-9327-748236b8cf28 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:36.219064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fd8da090-f62e-42b1-9327-748236b8cf28 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:36.307536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fd8da090-f62e-42b1-9327-748236b8cf28 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:36.315676 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fd8da090-f62e-42b1-9327-748236b8cf28 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1237 microversion: 2.1 time: 0.115777 Jun 22 09:07:36.316267 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 30/49] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:36 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1237 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:36.634685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-00ae5423-e369-489f-a0c6-606b15d5f9f1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:36.635409 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-00ae5423-e369-489f-a0c6-606b15d5f9f1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:36.641856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00ae5423-e369-489f-a0c6-606b15d5f9f1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:36.642427 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00ae5423-e369-489f-a0c6-606b15d5f9f1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:36.643354 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00ae5423-e369-489f-a0c6-606b15d5f9f1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:36.643915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00ae5423-e369-489f-a0c6-606b15d5f9f1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:36.891607 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-00ae5423-e369-489f-a0c6-606b15d5f9f1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:36.902160 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-00ae5423-e369-489f-a0c6-606b15d5f9f1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.271033 Jun 22 09:07:36.903321 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 20/50] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:36 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:36.972216 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bc5341b1-b6e7-4005-baec-5ae111601b10 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:36.973476 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bc5341b1-b6e7-4005-baec-5ae111601b10 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:36.988190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc5341b1-b6e7-4005-baec-5ae111601b10 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:36.988716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc5341b1-b6e7-4005-baec-5ae111601b10 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:36.989682 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc5341b1-b6e7-4005-baec-5ae111601b10 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:36.990127 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc5341b1-b6e7-4005-baec-5ae111601b10 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.017121 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b438d1b1-3225-4039-ada0-5b96549abad1 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:37.018041 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b438d1b1-3225-4039-ada0-5b96549abad1 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:37.026397 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b438d1b1-3225-4039-ada0-5b96549abad1 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:37.027187 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b438d1b1-3225-4039-ada0-5b96549abad1 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.028179 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b438d1b1-3225-4039-ada0-5b96549abad1 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:37.029575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b438d1b1-3225-4039-ada0-5b96549abad1 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.235095 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bc5341b1-b6e7-4005-baec-5ae111601b10 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:37.269229 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bc5341b1-b6e7-4005-baec-5ae111601b10 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.303113 Jun 22 09:07:37.269927 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 31/51] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:36 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:37.335620 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0943db0c-132c-4331-8ac6-b4f8e5bc6238 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:37.335620 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0943db0c-132c-4331-8ac6-b4f8e5bc6238 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:37.343623 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b438d1b1-3225-4039-ada0-5b96549abad1 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:37.345939 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0943db0c-132c-4331-8ac6-b4f8e5bc6238 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:37.347646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0943db0c-132c-4331-8ac6-b4f8e5bc6238 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.350064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0943db0c-132c-4331-8ac6-b4f8e5bc6238 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:37.351811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0943db0c-132c-4331-8ac6-b4f8e5bc6238 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.368263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b438d1b1-3225-4039-ada0-5b96549abad1 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.355976 Jun 22 09:07:37.372548 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 21/52] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:37 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:37.453709 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0943db0c-132c-4331-8ac6-b4f8e5bc6238 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:37.468210 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0943db0c-132c-4331-8ac6-b4f8e5bc6238 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1237 microversion: 2.1 time: 0.138948 Jun 22 09:07:37.468798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 32/53] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:37 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1237 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:37.797084 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-c9c88668-f0d5-4e07-863f-256d8aac6e54 req-d1d660c5-f34d-4df9-a01e-8ec44ad40f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf015553-3a8f-459a-a15a-f269b6d3dae6", "tag": "0ae128fa-373b-4d19-b6a6-ca5d9a45df96"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:37.813457 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c9c88668-f0d5-4e07-863f-256d8aac6e54 req-d1d660c5-f34d-4df9-a01e-8ec44ad40f22 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:37.813457 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c9c88668-f0d5-4e07-863f-256d8aac6e54 req-d1d660c5-f34d-4df9-a01e-8ec44ad40f22 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.828230 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-c9c88668-f0d5-4e07-863f-256d8aac6e54 req-d1d660c5-f34d-4df9-a01e-8ec44ad40f22 service nova] Creating event network-changed:0ae128fa-373b-4d19-b6a6-ca5d9a45df96 for instance cf015553-3a8f-459a-a15a-f269b6d3dae6 on hv-cinder-80382 Jun 22 09:07:37.828753 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c9c88668-f0d5-4e07-863f-256d8aac6e54 req-d1d660c5-f34d-4df9-a01e-8ec44ad40f22 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 09:07:37.829824 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8eb0fb81-f7e4-4027-88ea-5fde053dbf7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:37.830339 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8eb0fb81-f7e4-4027-88ea-5fde053dbf7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.831154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8eb0fb81-f7e4-4027-88ea-5fde053dbf7c None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:37.831586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8eb0fb81-f7e4-4027-88ea-5fde053dbf7c None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.839910 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.compute.rpcapi [None req-8eb0fb81-f7e4-4027-88ea-5fde053dbf7c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 09:07:37.840763 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8eb0fb81-f7e4-4027-88ea-5fde053dbf7c None None] Releasing lock "compute-rpcapi-router" {{(pid=118267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 09:07:37.855818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8eb0fb81-f7e4-4027-88ea-5fde053dbf7c None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.366329 Jun 22 09:07:37.859654 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 22/54] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:37.919728 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6b6971d6-af7c-4a48-aade-ee7d3faca2cc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:37.920339 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6b6971d6-af7c-4a48-aade-ee7d3faca2cc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:37.927825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6b6971d6-af7c-4a48-aade-ee7d3faca2cc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:37.928277 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6b6971d6-af7c-4a48-aade-ee7d3faca2cc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.929059 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6b6971d6-af7c-4a48-aade-ee7d3faca2cc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:37.929696 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6b6971d6-af7c-4a48-aade-ee7d3faca2cc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.121947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6b6971d6-af7c-4a48-aade-ee7d3faca2cc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:38.141602 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6b6971d6-af7c-4a48-aade-ee7d3faca2cc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.216630 Jun 22 09:07:38.141602 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 33/55] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:37 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:38.296534 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-31ee95da-54c4-4e98-9506-6ffa7a641b1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:38.298676 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-31ee95da-54c4-4e98-9506-6ffa7a641b1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:38.322198 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31ee95da-54c4-4e98-9506-6ffa7a641b1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.322704 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31ee95da-54c4-4e98-9506-6ffa7a641b1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.323629 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31ee95da-54c4-4e98-9506-6ffa7a641b1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.324031 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-31ee95da-54c4-4e98-9506-6ffa7a641b1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.388995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ef4940f3-7f1c-4b4a-8c24-5b98bc84d075 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:38.390292 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ef4940f3-7f1c-4b4a-8c24-5b98bc84d075 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:38.401404 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ef4940f3-7f1c-4b4a-8c24-5b98bc84d075 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.402346 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ef4940f3-7f1c-4b4a-8c24-5b98bc84d075 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.403479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ef4940f3-7f1c-4b4a-8c24-5b98bc84d075 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.404205 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ef4940f3-7f1c-4b4a-8c24-5b98bc84d075 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.452027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:38.592508 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-31ee95da-54c4-4e98-9506-6ffa7a641b1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:38.610050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-31ee95da-54c4-4e98-9506-6ffa7a641b1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.326246 Jun 22 09:07:38.615585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 23/56] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:38 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:38.636853 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ba4e9759-989f-4aa8-bc6a-f302ef2269d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:38.638398 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ba4e9759-989f-4aa8-bc6a-f302ef2269d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:38.656786 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba4e9759-989f-4aa8-bc6a-f302ef2269d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.657425 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba4e9759-989f-4aa8-bc6a-f302ef2269d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.658391 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba4e9759-989f-4aa8-bc6a-f302ef2269d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.658994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba4e9759-989f-4aa8-bc6a-f302ef2269d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.782745 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ba4e9759-989f-4aa8-bc6a-f302ef2269d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:38.798499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ba4e9759-989f-4aa8-bc6a-f302ef2269d9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1237 microversion: 2.1 time: 0.179536 Jun 22 09:07:38.815364 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 24/57] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:38 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1237 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:38.871998 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ef4940f3-7f1c-4b4a-8c24-5b98bc84d075 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:38.884858 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ef4940f3-7f1c-4b4a-8c24-5b98bc84d075 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.499395 Jun 22 09:07:38.896400 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 34/58] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:38 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:39.148275 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3d18504b-b767-46a3-a5af-c6765124cae0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:39.149012 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3d18504b-b767-46a3-a5af-c6765124cae0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:39.155918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3d18504b-b767-46a3-a5af-c6765124cae0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.156465 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3d18504b-b767-46a3-a5af-c6765124cae0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.157325 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3d18504b-b767-46a3-a5af-c6765124cae0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.157837 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3d18504b-b767-46a3-a5af-c6765124cae0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.311509 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3d18504b-b767-46a3-a5af-c6765124cae0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:39.319688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3d18504b-b767-46a3-a5af-c6765124cae0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.175221 Jun 22 09:07:39.322719 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 25/59] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:39 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:39.643238 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-95636678-76af-4438-913d-98a9f1a78b50 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:39.648942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-95636678-76af-4438-913d-98a9f1a78b50 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:39.659172 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-95636678-76af-4438-913d-98a9f1a78b50 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.713366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-95636678-76af-4438-913d-98a9f1a78b50 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.713366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-95636678-76af-4438-913d-98a9f1a78b50 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.713366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-95636678-76af-4438-913d-98a9f1a78b50 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.773816 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=22 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:39.828208 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3e340941-eb22-470e-a565-fe5ea7998819 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:39.829475 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3e340941-eb22-470e-a565-fe5ea7998819 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:39.850961 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3e340941-eb22-470e-a565-fe5ea7998819 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.852092 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3e340941-eb22-470e-a565-fe5ea7998819 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.853816 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3e340941-eb22-470e-a565-fe5ea7998819 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.856733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3e340941-eb22-470e-a565-fe5ea7998819 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.889996 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-95636678-76af-4438-913d-98a9f1a78b50 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:39.901040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-95636678-76af-4438-913d-98a9f1a78b50 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.274600 Jun 22 09:07:39.911283 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 35/60] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:39 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:39.921549 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-e9fb7ecc-b755-4422-9e59-3ebee0af00ae req-d94c9db0-772c-4751-aaa2-accd2ad95f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1905450d-b26c-4e46-914b-a6a04d9cc7b1", "tag": "974e9d62-8fe0-47bd-ad36-3e266d639c90"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:39.953641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-e9fb7ecc-b755-4422-9e59-3ebee0af00ae req-d94c9db0-772c-4751-aaa2-accd2ad95f76 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.954134 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-e9fb7ecc-b755-4422-9e59-3ebee0af00ae req-d94c9db0-772c-4751-aaa2-accd2ad95f76 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.981466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3e340941-eb22-470e-a565-fe5ea7998819 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:39.989998 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-e9fb7ecc-b755-4422-9e59-3ebee0af00ae req-d94c9db0-772c-4751-aaa2-accd2ad95f76 service nova] Creating event network-changed:974e9d62-8fe0-47bd-ad36-3e266d639c90 for instance 1905450d-b26c-4e46-914b-a6a04d9cc7b1 on hv-cinder-80382 Jun 22 09:07:39.989998 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-e9fb7ecc-b755-4422-9e59-3ebee0af00ae req-d94c9db0-772c-4751-aaa2-accd2ad95f76 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118268) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 09:07:39.989998 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bf4d4b33-5aef-446a-b9aa-30bdcca161c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.990612 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3e340941-eb22-470e-a565-fe5ea7998819 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1237 microversion: 2.1 time: 0.166831 Jun 22 09:07:39.990706 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bf4d4b33-5aef-446a-b9aa-30bdcca161c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.990794 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bf4d4b33-5aef-446a-b9aa-30bdcca161c5 None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.991262 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bf4d4b33-5aef-446a-b9aa-30bdcca161c5 None None] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.993115 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 26/61] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:39 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1237 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:40.024972 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b23b0888-ce92-4681-9f29-654623554bea tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:40.025187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.compute.rpcapi [None req-bf4d4b33-5aef-446a-b9aa-30bdcca161c5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 09:07:40.025285 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b23b0888-ce92-4681-9f29-654623554bea tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:40.025388 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bf4d4b33-5aef-446a-b9aa-30bdcca161c5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118268) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 09:07:40.025487 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b23b0888-ce92-4681-9f29-654623554bea tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.025487 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b23b0888-ce92-4681-9f29-654623554bea tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:40.026604 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b23b0888-ce92-4681-9f29-654623554bea tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.027385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b23b0888-ce92-4681-9f29-654623554bea tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:40.077520 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bf4d4b33-5aef-446a-b9aa-30bdcca161c5 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164922 Jun 22 09:07:40.078391 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 36/62] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:40.214094 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b23b0888-ce92-4681-9f29-654623554bea tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:40.222918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b23b0888-ce92-4681-9f29-654623554bea tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.218563 Jun 22 09:07:40.223986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 27/63] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:40 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:40.339593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-feeefac1-8f6a-4dc2-b04a-c008d1241196 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:40.340530 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-feeefac1-8f6a-4dc2-b04a-c008d1241196 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:40.348087 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-feeefac1-8f6a-4dc2-b04a-c008d1241196 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.348863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-feeefac1-8f6a-4dc2-b04a-c008d1241196 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:40.350126 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-feeefac1-8f6a-4dc2-b04a-c008d1241196 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.350768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-feeefac1-8f6a-4dc2-b04a-c008d1241196 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:40.535024 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-feeefac1-8f6a-4dc2-b04a-c008d1241196 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:40.545612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-feeefac1-8f6a-4dc2-b04a-c008d1241196 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.211582 Jun 22 09:07:40.547228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 37/64] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:40 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:40.926394 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ca1e50b9-8a77-4738-b32c-59a76ded1a5b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:40.927848 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ca1e50b9-8a77-4738-b32c-59a76ded1a5b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:40.937723 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ca1e50b9-8a77-4738-b32c-59a76ded1a5b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.938626 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ca1e50b9-8a77-4738-b32c-59a76ded1a5b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:40.939998 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ca1e50b9-8a77-4738-b32c-59a76ded1a5b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.946118 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ca1e50b9-8a77-4738-b32c-59a76ded1a5b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:41.015310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-26753660-c6bc-4555-bfd8-6f01429ee867 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:41.016538 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-26753660-c6bc-4555-bfd8-6f01429ee867 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:41.023386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-26753660-c6bc-4555-bfd8-6f01429ee867 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:41.023840 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-26753660-c6bc-4555-bfd8-6f01429ee867 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:41.033440 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-26753660-c6bc-4555-bfd8-6f01429ee867 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:41.033613 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-26753660-c6bc-4555-bfd8-6f01429ee867 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:41.149706 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-26753660-c6bc-4555-bfd8-6f01429ee867 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:41.162545 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-26753660-c6bc-4555-bfd8-6f01429ee867 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1237 microversion: 2.1 time: 0.152550 Jun 22 09:07:41.165758 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 38/65] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:41 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1237 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:41.175523 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ca1e50b9-8a77-4738-b32c-59a76ded1a5b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:41.193461 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ca1e50b9-8a77-4738-b32c-59a76ded1a5b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.278380 Jun 22 09:07:41.195447 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 28/66] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:40 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:41.273832 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ebad8639-0d3d-4b94-9b09-ce1dc01ef494 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:41.273832 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ebad8639-0d3d-4b94-9b09-ce1dc01ef494 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:41.273832 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ebad8639-0d3d-4b94-9b09-ce1dc01ef494 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:41.273832 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ebad8639-0d3d-4b94-9b09-ce1dc01ef494 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:41.274357 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ebad8639-0d3d-4b94-9b09-ce1dc01ef494 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:41.274357 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ebad8639-0d3d-4b94-9b09-ce1dc01ef494 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:41.565331 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-00533880-0650-493e-ad6e-0f89a5a7f495 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:41.566439 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-00533880-0650-493e-ad6e-0f89a5a7f495 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:41.576339 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00533880-0650-493e-ad6e-0f89a5a7f495 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:41.577573 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00533880-0650-493e-ad6e-0f89a5a7f495 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:41.578598 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00533880-0650-493e-ad6e-0f89a5a7f495 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:41.579321 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00533880-0650-493e-ad6e-0f89a5a7f495 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:42.143842 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ebad8639-0d3d-4b94-9b09-ce1dc01ef494 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:42.161049 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ebad8639-0d3d-4b94-9b09-ce1dc01ef494 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.921994 Jun 22 09:07:42.166979 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 39/67] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:41 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:42.187842 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c630439c-c65d-4bbc-94f8-0baff28d9bec tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:42.191965 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c630439c-c65d-4bbc-94f8-0baff28d9bec tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:42.204699 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c630439c-c65d-4bbc-94f8-0baff28d9bec tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:42.205373 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c630439c-c65d-4bbc-94f8-0baff28d9bec tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:42.206351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c630439c-c65d-4bbc-94f8-0baff28d9bec tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:42.207145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c630439c-c65d-4bbc-94f8-0baff28d9bec tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:42.331188 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c630439c-c65d-4bbc-94f8-0baff28d9bec tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:42.365242 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c630439c-c65d-4bbc-94f8-0baff28d9bec tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1293 microversion: 2.1 time: 0.187442 Jun 22 09:07:42.365876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 40/68] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:42 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1293 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:42.396210 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d62d8764-ea6d-4239-ac4f-e9fbe3d67c6f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:42.396834 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d62d8764-ea6d-4239-ac4f-e9fbe3d67c6f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:42.399796 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-00533880-0650-493e-ad6e-0f89a5a7f495 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:42.410568 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-00533880-0650-493e-ad6e-0f89a5a7f495 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.850337 Jun 22 09:07:42.413381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:42.416094 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 29/69] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:41 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:42.427372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d62d8764-ea6d-4239-ac4f-e9fbe3d67c6f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:42.429130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d62d8764-ea6d-4239-ac4f-e9fbe3d67c6f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:42.432925 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d62d8764-ea6d-4239-ac4f-e9fbe3d67c6f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:42.433477 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d62d8764-ea6d-4239-ac4f-e9fbe3d67c6f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:42.882847 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d62d8764-ea6d-4239-ac4f-e9fbe3d67c6f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:42.897549 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d62d8764-ea6d-4239-ac4f-e9fbe3d67c6f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.513463 Jun 22 09:07:42.907416 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 41/70] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:42 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:43.191534 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a3eab22a-9460-4009-81ea-1e2f7f200468 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:43.191534 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a3eab22a-9460-4009-81ea-1e2f7f200468 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:43.196689 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a3eab22a-9460-4009-81ea-1e2f7f200468 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.197444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a3eab22a-9460-4009-81ea-1e2f7f200468 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.199398 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a3eab22a-9460-4009-81ea-1e2f7f200468 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.200294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a3eab22a-9460-4009-81ea-1e2f7f200468 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.383643 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fd9fad34-17a3-4e78-b861-4d690296ebe0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:43.384491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-fd9fad34-17a3-4e78-b861-4d690296ebe0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:43.394578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fd9fad34-17a3-4e78-b861-4d690296ebe0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.397730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fd9fad34-17a3-4e78-b861-4d690296ebe0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.398743 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fd9fad34-17a3-4e78-b861-4d690296ebe0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.399237 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fd9fad34-17a3-4e78-b861-4d690296ebe0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.793784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fd9fad34-17a3-4e78-b861-4d690296ebe0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:43.793784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fd9fad34-17a3-4e78-b861-4d690296ebe0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1293 microversion: 2.1 time: 0.347843 Jun 22 09:07:43.793784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 42/71] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:43 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1293 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:43.793784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ede9fac0-282b-49d0-aa50-75cb8c3e1fd5 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:43.798145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ede9fac0-282b-49d0-aa50-75cb8c3e1fd5 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:43.798145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ede9fac0-282b-49d0-aa50-75cb8c3e1fd5 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.798145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ede9fac0-282b-49d0-aa50-75cb8c3e1fd5 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.798145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ede9fac0-282b-49d0-aa50-75cb8c3e1fd5 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.799811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ede9fac0-282b-49d0-aa50-75cb8c3e1fd5 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.799956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a3eab22a-9460-4009-81ea-1e2f7f200468 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:43.799956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a3eab22a-9460-4009-81ea-1e2f7f200468 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.594563 Jun 22 09:07:43.799956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 30/72] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:43 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:44.020333 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-68c7cc72-78d0-4dd8-8cac-66e24dac947f req-49a02a5a-8a0a-4a4b-9d07-c9c8df49938a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a986f8d-3000-440e-b006-4c90b7c765fa", "tag": "c0eb72f1-4dd3-41ec-bab1-7fb490daf290"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:44.042755 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-68c7cc72-78d0-4dd8-8cac-66e24dac947f req-49a02a5a-8a0a-4a4b-9d07-c9c8df49938a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:44.046636 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-68c7cc72-78d0-4dd8-8cac-66e24dac947f req-49a02a5a-8a0a-4a4b-9d07-c9c8df49938a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:44.091786 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-68c7cc72-78d0-4dd8-8cac-66e24dac947f req-49a02a5a-8a0a-4a4b-9d07-c9c8df49938a service nova] Creating event network-changed:c0eb72f1-4dd3-41ec-bab1-7fb490daf290 for instance 7a986f8d-3000-440e-b006-4c90b7c765fa on hv-cinder-80382 Jun 22 09:07:44.121047 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-68c7cc72-78d0-4dd8-8cac-66e24dac947f req-49a02a5a-8a0a-4a4b-9d07-c9c8df49938a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239103 Jun 22 09:07:44.123690 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 31/73] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:07:44.141162 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-83c3ddaa-0d6c-412b-a082-4f0f5eee661e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:44.142543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-83c3ddaa-0d6c-412b-a082-4f0f5eee661e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:44.162294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-83c3ddaa-0d6c-412b-a082-4f0f5eee661e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:44.165369 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-83c3ddaa-0d6c-412b-a082-4f0f5eee661e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:44.166356 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-83c3ddaa-0d6c-412b-a082-4f0f5eee661e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:44.167973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-83c3ddaa-0d6c-412b-a082-4f0f5eee661e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:44.527489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ede9fac0-282b-49d0-aa50-75cb8c3e1fd5 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:44.540675 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ede9fac0-282b-49d0-aa50-75cb8c3e1fd5 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.805037 Jun 22 09:07:44.541471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 43/74] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:43 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:44.819808 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-56f64fb9-1b42-4753-9362-fa3d1f54e807 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:44.820641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-56f64fb9-1b42-4753-9362-fa3d1f54e807 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:44.833190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56f64fb9-1b42-4753-9362-fa3d1f54e807 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:44.833873 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56f64fb9-1b42-4753-9362-fa3d1f54e807 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:44.834814 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56f64fb9-1b42-4753-9362-fa3d1f54e807 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:44.835592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56f64fb9-1b42-4753-9362-fa3d1f54e807 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:45.129757 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-83c3ddaa-0d6c-412b-a082-4f0f5eee661e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:45.148518 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-83c3ddaa-0d6c-412b-a082-4f0f5eee661e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 1.020799 Jun 22 09:07:45.153590 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 32/75] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:44 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:45.163995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cb399c30-b558-4462-bf8c-49923d0d7dd1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:45.165219 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cb399c30-b558-4462-bf8c-49923d0d7dd1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:45.180455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb399c30-b558-4462-bf8c-49923d0d7dd1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:45.182242 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb399c30-b558-4462-bf8c-49923d0d7dd1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:45.183622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb399c30-b558-4462-bf8c-49923d0d7dd1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:45.184277 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb399c30-b558-4462-bf8c-49923d0d7dd1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:45.190373 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=36 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:45.317788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cb399c30-b558-4462-bf8c-49923d0d7dd1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:45.317788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cb399c30-b558-4462-bf8c-49923d0d7dd1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1299 microversion: 2.1 time: 0.156581 Jun 22 09:07:45.317788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 33/76] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:45 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:45.453828 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-56f64fb9-1b42-4753-9362-fa3d1f54e807 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:45.464046 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-56f64fb9-1b42-4753-9362-fa3d1f54e807 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.651852 Jun 22 09:07:45.467909 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 44/77] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:44 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:45.557668 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8bf84a88-1a34-4f5d-9c8d-e8930a401284 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:45.558280 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8bf84a88-1a34-4f5d-9c8d-e8930a401284 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:45.570287 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8bf84a88-1a34-4f5d-9c8d-e8930a401284 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:45.570734 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8bf84a88-1a34-4f5d-9c8d-e8930a401284 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:45.571543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8bf84a88-1a34-4f5d-9c8d-e8930a401284 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:45.571975 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8bf84a88-1a34-4f5d-9c8d-e8930a401284 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:45.593506 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=100 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:46.165644 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-438bc9ac-f388-42a7-a19c-2c601ca707a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:46.166251 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-438bc9ac-f388-42a7-a19c-2c601ca707a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:46.177742 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-438bc9ac-f388-42a7-a19c-2c601ca707a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.178190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-438bc9ac-f388-42a7-a19c-2c601ca707a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.179276 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-438bc9ac-f388-42a7-a19c-2c601ca707a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.179797 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-438bc9ac-f388-42a7-a19c-2c601ca707a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.257580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8bf84a88-1a34-4f5d-9c8d-e8930a401284 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:46.269438 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8bf84a88-1a34-4f5d-9c8d-e8930a401284 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.715796 Jun 22 09:07:46.271054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 34/78] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:45 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:46.282364 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-d7dbf4e6-f16e-4418-91b0-58839331b030 req-f9e1d71b-cfb0-4c4f-bdba-ea7131aee8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ae5dc0-905f-467a-904f-af2631f8e574", "tag": "61559b1c-64d4-490b-bed9-7974553e8e11"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:46.324434 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-d7dbf4e6-f16e-4418-91b0-58839331b030 req-f9e1d71b-cfb0-4c4f-bdba-ea7131aee8bb service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.325429 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-d7dbf4e6-f16e-4418-91b0-58839331b030 req-f9e1d71b-cfb0-4c4f-bdba-ea7131aee8bb service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.343941 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-d7dbf4e6-f16e-4418-91b0-58839331b030 req-f9e1d71b-cfb0-4c4f-bdba-ea7131aee8bb service nova] Creating event network-changed:61559b1c-64d4-490b-bed9-7974553e8e11 for instance 13ae5dc0-905f-467a-904f-af2631f8e574 on hv-cinder-80382 Jun 22 09:07:46.353281 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-d7dbf4e6-f16e-4418-91b0-58839331b030 req-f9e1d71b-cfb0-4c4f-bdba-ea7131aee8bb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080281 Jun 22 09:07:46.354121 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 35/79] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:46.361944 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f3c67d80-5424-4d39-8136-661abe570952 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:46.362704 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f3c67d80-5424-4d39-8136-661abe570952 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:46.369264 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f3c67d80-5424-4d39-8136-661abe570952 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.370058 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f3c67d80-5424-4d39-8136-661abe570952 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.371610 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f3c67d80-5424-4d39-8136-661abe570952 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.372179 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f3c67d80-5424-4d39-8136-661abe570952 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.385479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-438bc9ac-f388-42a7-a19c-2c601ca707a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:46.397556 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-438bc9ac-f388-42a7-a19c-2c601ca707a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.235622 Jun 22 09:07:46.399248 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 45/80] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:46 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:46.458134 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f3c67d80-5424-4d39-8136-661abe570952 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:46.467467 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f3c67d80-5424-4d39-8136-661abe570952 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1299 microversion: 2.1 time: 0.111807 Jun 22 09:07:46.468490 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 36/81] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:46 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:46.487810 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2b67f213-7b83-4128-9499-12f901cae202 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:46.488155 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2b67f213-7b83-4128-9499-12f901cae202 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:46.494905 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2b67f213-7b83-4128-9499-12f901cae202 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.495475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2b67f213-7b83-4128-9499-12f901cae202 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.496680 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2b67f213-7b83-4128-9499-12f901cae202 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.497233 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2b67f213-7b83-4128-9499-12f901cae202 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.773728 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2b67f213-7b83-4128-9499-12f901cae202 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:46.783685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2b67f213-7b83-4128-9499-12f901cae202 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.300955 Jun 22 09:07:46.786759 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 46/82] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:46 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:47.285945 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fd455c5e-a6ae-41a9-a217-44de900590b1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:47.286578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fd455c5e-a6ae-41a9-a217-44de900590b1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:47.293501 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fd455c5e-a6ae-41a9-a217-44de900590b1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.293955 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fd455c5e-a6ae-41a9-a217-44de900590b1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.295276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fd455c5e-a6ae-41a9-a217-44de900590b1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.295712 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fd455c5e-a6ae-41a9-a217-44de900590b1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.417222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d04952dc-766b-45be-be0a-de10a2269b07 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:47.418579 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d04952dc-766b-45be-be0a-de10a2269b07 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:47.427193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d04952dc-766b-45be-be0a-de10a2269b07 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.428179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d04952dc-766b-45be-be0a-de10a2269b07 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.429320 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d04952dc-766b-45be-be0a-de10a2269b07 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.430264 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d04952dc-766b-45be-be0a-de10a2269b07 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.448468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fd455c5e-a6ae-41a9-a217-44de900590b1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:47.457127 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fd455c5e-a6ae-41a9-a217-44de900590b1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.175481 Jun 22 09:07:47.458343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 37/83] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:47 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:47.485316 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e89e28b5-5b22-40b6-9d20-f6372cdc59c3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:47.485927 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e89e28b5-5b22-40b6-9d20-f6372cdc59c3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:47.492292 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e89e28b5-5b22-40b6-9d20-f6372cdc59c3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.493081 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e89e28b5-5b22-40b6-9d20-f6372cdc59c3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.493662 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e89e28b5-5b22-40b6-9d20-f6372cdc59c3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.494100 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e89e28b5-5b22-40b6-9d20-f6372cdc59c3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.573675 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d04952dc-766b-45be-be0a-de10a2269b07 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:47.595669 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d04952dc-766b-45be-be0a-de10a2269b07 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.183667 Jun 22 09:07:47.596341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 47/84] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:47 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:47.743886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e89e28b5-5b22-40b6-9d20-f6372cdc59c3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:47.756584 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e89e28b5-5b22-40b6-9d20-f6372cdc59c3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.275798 Jun 22 09:07:47.757575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 38/85] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:47 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:47.803579 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-96c05b44-2c05-4b7b-a10e-9d2466b8e2f4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:47.804500 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-96c05b44-2c05-4b7b-a10e-9d2466b8e2f4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:47.813267 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-96c05b44-2c05-4b7b-a10e-9d2466b8e2f4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.814187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-96c05b44-2c05-4b7b-a10e-9d2466b8e2f4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.815467 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-96c05b44-2c05-4b7b-a10e-9d2466b8e2f4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.816417 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-96c05b44-2c05-4b7b-a10e-9d2466b8e2f4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.006207 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-96c05b44-2c05-4b7b-a10e-9d2466b8e2f4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:48.013640 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-96c05b44-2c05-4b7b-a10e-9d2466b8e2f4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.214987 Jun 22 09:07:48.014219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 48/86] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:47 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:48.485567 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-79fe766e-da51-4588-884d-88f0d64e1be7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:48.485567 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-79fe766e-da51-4588-884d-88f0d64e1be7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:48.489507 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=10 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:48.496695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-79fe766e-da51-4588-884d-88f0d64e1be7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.497513 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-79fe766e-da51-4588-884d-88f0d64e1be7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.498792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-79fe766e-da51-4588-884d-88f0d64e1be7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.500440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-79fe766e-da51-4588-884d-88f0d64e1be7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.620621 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6ea8c0f2-4e1c-457a-85b0-0ea823931e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:48.621239 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6ea8c0f2-4e1c-457a-85b0-0ea823931e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:48.629504 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ea8c0f2-4e1c-457a-85b0-0ea823931e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.630746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ea8c0f2-4e1c-457a-85b0-0ea823931e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.631681 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ea8c0f2-4e1c-457a-85b0-0ea823931e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.632331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ea8c0f2-4e1c-457a-85b0-0ea823931e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.751244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-79fe766e-da51-4588-884d-88f0d64e1be7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:48.761873 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-79fe766e-da51-4588-884d-88f0d64e1be7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.291255 Jun 22 09:07:48.763852 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 39/87] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:48 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:48.781665 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8681be29-a389-4e70-9af8-e40ff34b4b3a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:48.782578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8681be29-a389-4e70-9af8-e40ff34b4b3a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:48.801809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8681be29-a389-4e70-9af8-e40ff34b4b3a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.801809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8681be29-a389-4e70-9af8-e40ff34b4b3a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.801809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8681be29-a389-4e70-9af8-e40ff34b4b3a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.801809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8681be29-a389-4e70-9af8-e40ff34b4b3a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.877108 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6ea8c0f2-4e1c-457a-85b0-0ea823931e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:48.889993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6ea8c0f2-4e1c-457a-85b0-0ea823931e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.277840 Jun 22 09:07:48.895739 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 49/88] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:48 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:48.968373 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-375accf3-be8d-4033-b008-f2cfb436cfcd req-d7e79b91-0469-41df-a1b5-774e0f8b5c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "139fc621-9e20-4f05-9935-92b048cc48a1", "tag": "daa50036-a697-4fc0-8fc6-23a1965628ef"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:48.979912 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-375accf3-be8d-4033-b008-f2cfb436cfcd req-d7e79b91-0469-41df-a1b5-774e0f8b5c5c service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.980532 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-375accf3-be8d-4033-b008-f2cfb436cfcd req-d7e79b91-0469-41df-a1b5-774e0f8b5c5c service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:49.046457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-375accf3-be8d-4033-b008-f2cfb436cfcd req-d7e79b91-0469-41df-a1b5-774e0f8b5c5c service nova] Creating event network-changed:daa50036-a697-4fc0-8fc6-23a1965628ef for instance 139fc621-9e20-4f05-9935-92b048cc48a1 on hv-cinder-80382 Jun 22 09:07:49.055697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-375accf3-be8d-4033-b008-f2cfb436cfcd req-d7e79b91-0469-41df-a1b5-774e0f8b5c5c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090510 Jun 22 09:07:49.060198 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 50/89] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:49.073464 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7ee23e0b-1346-4820-9f66-20f5dabe5bac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:49.076649 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7ee23e0b-1346-4820-9f66-20f5dabe5bac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:49.084142 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7ee23e0b-1346-4820-9f66-20f5dabe5bac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:49.084985 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7ee23e0b-1346-4820-9f66-20f5dabe5bac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:49.085940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7ee23e0b-1346-4820-9f66-20f5dabe5bac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:49.086531 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7ee23e0b-1346-4820-9f66-20f5dabe5bac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:49.202662 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8681be29-a389-4e70-9af8-e40ff34b4b3a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:49.205648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8681be29-a389-4e70-9af8-e40ff34b4b3a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.435316 Jun 22 09:07:49.206716 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 40/90] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:48 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:49.258428 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7ee23e0b-1346-4820-9f66-20f5dabe5bac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:49.264889 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:49.267704 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7ee23e0b-1346-4820-9f66-20f5dabe5bac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.205220 Jun 22 09:07:49.268690 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 51/91] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:49 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:49.784601 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7b12ff3e-0e37-4047-b7c8-816229043317 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:49.786485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7b12ff3e-0e37-4047-b7c8-816229043317 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:49.795114 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7b12ff3e-0e37-4047-b7c8-816229043317 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:49.795870 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7b12ff3e-0e37-4047-b7c8-816229043317 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:49.796814 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7b12ff3e-0e37-4047-b7c8-816229043317 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:49.797420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7b12ff3e-0e37-4047-b7c8-816229043317 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:49.908368 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c27c4452-c13f-4f14-bed4-8177de3035f2 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:49.909714 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c27c4452-c13f-4f14-bed4-8177de3035f2 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:49.916231 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c27c4452-c13f-4f14-bed4-8177de3035f2 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:49.917011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c27c4452-c13f-4f14-bed4-8177de3035f2 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:49.917958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c27c4452-c13f-4f14-bed4-8177de3035f2 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:49.918727 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c27c4452-c13f-4f14-bed4-8177de3035f2 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.008595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:50.187888 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c27c4452-c13f-4f14-bed4-8177de3035f2 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:50.209059 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c27c4452-c13f-4f14-bed4-8177de3035f2 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.304003 Jun 22 09:07:50.222904 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 52/92] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:49 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:50.229640 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f1797ef5-9597-43f3-8597-02ffb40ff655 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:50.230530 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f1797ef5-9597-43f3-8597-02ffb40ff655 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:50.247489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f1797ef5-9597-43f3-8597-02ffb40ff655 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.248276 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f1797ef5-9597-43f3-8597-02ffb40ff655 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.250938 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f1797ef5-9597-43f3-8597-02ffb40ff655 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.251567 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f1797ef5-9597-43f3-8597-02ffb40ff655 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.353731 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7b12ff3e-0e37-4047-b7c8-816229043317 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:50.366493 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7b12ff3e-0e37-4047-b7c8-816229043317 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.582540 Jun 22 09:07:50.377083 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 41/93] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:49 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:50.380033 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-44a4a085-4431-49d5-9b75-08e0c969124c tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:50.380688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-44a4a085-4431-49d5-9b75-08e0c969124c tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:50.402879 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-44a4a085-4431-49d5-9b75-08e0c969124c tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.405215 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-44a4a085-4431-49d5-9b75-08e0c969124c tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.406059 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-44a4a085-4431-49d5-9b75-08e0c969124c tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.406499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-44a4a085-4431-49d5-9b75-08e0c969124c tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.517018 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f1797ef5-9597-43f3-8597-02ffb40ff655 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:50.528341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f1797ef5-9597-43f3-8597-02ffb40ff655 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.303836 Jun 22 09:07:50.540007 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 53/94] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:50 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:50.877246 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-44a4a085-4431-49d5-9b75-08e0c969124c tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:50.888389 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-44a4a085-4431-49d5-9b75-08e0c969124c tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.517495 Jun 22 09:07:50.889797 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 42/95] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:50 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:51.228879 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-97ab3a3a-2903-4633-b3c0-c48efbab830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:51.229491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-97ab3a3a-2903-4633-b3c0-c48efbab830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:51.236496 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-97ab3a3a-2903-4633-b3c0-c48efbab830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.236880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-97ab3a3a-2903-4633-b3c0-c48efbab830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:51.237689 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-97ab3a3a-2903-4633-b3c0-c48efbab830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.238143 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-97ab3a3a-2903-4633-b3c0-c48efbab830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:51.377907 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-97ab3a3a-2903-4633-b3c0-c48efbab830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:51.385550 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b392a310-88f8-4bb9-a825-601ac423b9b2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:51.386232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b392a310-88f8-4bb9-a825-601ac423b9b2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:51.386345 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-97ab3a3a-2903-4633-b3c0-c48efbab830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.161826 Jun 22 09:07:51.387002 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 54/96] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:51 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:51.392557 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b392a310-88f8-4bb9-a825-601ac423b9b2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.393014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b392a310-88f8-4bb9-a825-601ac423b9b2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:51.393780 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b392a310-88f8-4bb9-a825-601ac423b9b2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.394215 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b392a310-88f8-4bb9-a825-601ac423b9b2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:51.528725 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b392a310-88f8-4bb9-a825-601ac423b9b2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:51.545876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7eb1676f-e56b-43b1-bf83-226ddbfc96d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:51.546952 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7eb1676f-e56b-43b1-bf83-226ddbfc96d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:51.551731 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b392a310-88f8-4bb9-a825-601ac423b9b2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.170083 Jun 22 09:07:51.552367 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 43/97] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:51 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:51.556113 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eb1676f-e56b-43b1-bf83-226ddbfc96d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.556860 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eb1676f-e56b-43b1-bf83-226ddbfc96d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:51.557739 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eb1676f-e56b-43b1-bf83-226ddbfc96d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.558464 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eb1676f-e56b-43b1-bf83-226ddbfc96d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:51.693445 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7eb1676f-e56b-43b1-bf83-226ddbfc96d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:51.701898 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7eb1676f-e56b-43b1-bf83-226ddbfc96d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.160429 Jun 22 09:07:51.702726 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 55/98] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:51 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:51.906387 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8432293a-6181-4d40-93d9-9ca1a3e3ba55 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:51.906964 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8432293a-6181-4d40-93d9-9ca1a3e3ba55 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:51.912921 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8432293a-6181-4d40-93d9-9ca1a3e3ba55 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.916525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8432293a-6181-4d40-93d9-9ca1a3e3ba55 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:51.916525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8432293a-6181-4d40-93d9-9ca1a3e3ba55 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.916525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8432293a-6181-4d40-93d9-9ca1a3e3ba55 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.162991 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8432293a-6181-4d40-93d9-9ca1a3e3ba55 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:52.175591 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8432293a-6181-4d40-93d9-9ca1a3e3ba55 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.274094 Jun 22 09:07:52.185920 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 44/99] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:51 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:52.403593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f2b850ea-246d-422a-a91b-77141b6e38ef tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:52.404200 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f2b850ea-246d-422a-a91b-77141b6e38ef tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:52.420489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2b850ea-246d-422a-a91b-77141b6e38ef tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.421234 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2b850ea-246d-422a-a91b-77141b6e38ef tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.424569 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2b850ea-246d-422a-a91b-77141b6e38ef tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.424569 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2b850ea-246d-422a-a91b-77141b6e38ef tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.573477 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6c4a702b-ac34-4a64-8360-777b16a19aae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:52.574090 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6c4a702b-ac34-4a64-8360-777b16a19aae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:52.582896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6c4a702b-ac34-4a64-8360-777b16a19aae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.583346 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6c4a702b-ac34-4a64-8360-777b16a19aae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.587564 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6c4a702b-ac34-4a64-8360-777b16a19aae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.588164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6c4a702b-ac34-4a64-8360-777b16a19aae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.821494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-6c4a702b-ac34-4a64-8360-777b16a19aae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:52.832498 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6c4a702b-ac34-4a64-8360-777b16a19aae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.264574 Jun 22 09:07:52.841256 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 45/100] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:52 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:52.871134 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1f557154-0227-4de6-97c4-e7dca4ff42f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:52.871811 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1f557154-0227-4de6-97c4-e7dca4ff42f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:52.898337 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1f557154-0227-4de6-97c4-e7dca4ff42f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.901622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1f557154-0227-4de6-97c4-e7dca4ff42f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.904174 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1f557154-0227-4de6-97c4-e7dca4ff42f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.904604 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1f557154-0227-4de6-97c4-e7dca4ff42f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.916195 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f2b850ea-246d-422a-a91b-77141b6e38ef tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:52.919861 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f2b850ea-246d-422a-a91b-77141b6e38ef tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.520280 Jun 22 09:07:52.920937 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 56/101] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:52 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:53.116571 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1f557154-0227-4de6-97c4-e7dca4ff42f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:53.124783 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1f557154-0227-4de6-97c4-e7dca4ff42f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.284767 Jun 22 09:07:53.127119 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 46/102] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:52 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:53.196975 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cb39973d-a485-4f14-8a0c-9d228f712a92 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:53.199289 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cb39973d-a485-4f14-8a0c-9d228f712a92 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:53.227864 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cb39973d-a485-4f14-8a0c-9d228f712a92 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.228754 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cb39973d-a485-4f14-8a0c-9d228f712a92 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.229803 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cb39973d-a485-4f14-8a0c-9d228f712a92 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.230671 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cb39973d-a485-4f14-8a0c-9d228f712a92 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.390899 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cb39973d-a485-4f14-8a0c-9d228f712a92 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:53.401705 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cb39973d-a485-4f14-8a0c-9d228f712a92 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.211292 Jun 22 09:07:53.408058 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 57/103] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:53 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:53.857444 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5b437b77-68d9-4092-881d-00e736d49d9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:53.858316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5b437b77-68d9-4092-881d-00e736d49d9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:53.865472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b437b77-68d9-4092-881d-00e736d49d9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.866054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b437b77-68d9-4092-881d-00e736d49d9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.867078 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b437b77-68d9-4092-881d-00e736d49d9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.867576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b437b77-68d9-4092-881d-00e736d49d9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.000229 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-d696ad39-6c25-43f9-b3f7-65cf0f546416 req-ac3ae6c1-cd60-4522-b28c-879ca81a6c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a986f8d-3000-440e-b006-4c90b7c765fa", "name": "network-vif-plugged", "status": "completed", "tag": "c0eb72f1-4dd3-41ec-bab1-7fb490daf290"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:54.011223 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-d696ad39-6c25-43f9-b3f7-65cf0f546416 req-ac3ae6c1-cd60-4522-b28c-879ca81a6c91 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.011669 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-d696ad39-6c25-43f9-b3f7-65cf0f546416 req-ac3ae6c1-cd60-4522-b28c-879ca81a6c91 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.029352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-d696ad39-6c25-43f9-b3f7-65cf0f546416 req-ac3ae6c1-cd60-4522-b28c-879ca81a6c91 service nova] Creating event network-vif-plugged:c0eb72f1-4dd3-41ec-bab1-7fb490daf290 for instance 7a986f8d-3000-440e-b006-4c90b7c765fa on hv-cinder-80382 Jun 22 09:07:54.035111 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5b437b77-68d9-4092-881d-00e736d49d9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:54.050692 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5b437b77-68d9-4092-881d-00e736d49d9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.195593 Jun 22 09:07:54.050692 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 58/104] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:53 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:54.052398 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-d696ad39-6c25-43f9-b3f7-65cf0f546416 req-ac3ae6c1-cd60-4522-b28c-879ca81a6c91 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284038 Jun 22 09:07:54.052990 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 47/105] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:07:54.057945 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2098d077-d3e3-471a-8fb7-62e46eaf3eac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:54.058752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2098d077-d3e3-471a-8fb7-62e46eaf3eac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:54.070958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2098d077-d3e3-471a-8fb7-62e46eaf3eac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.070958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2098d077-d3e3-471a-8fb7-62e46eaf3eac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.070958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2098d077-d3e3-471a-8fb7-62e46eaf3eac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.070958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2098d077-d3e3-471a-8fb7-62e46eaf3eac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.143294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-dbdfdbbf-0b51-4ec7-bff5-36676339d53e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:54.144748 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-dbdfdbbf-0b51-4ec7-bff5-36676339d53e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:54.153249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dbdfdbbf-0b51-4ec7-bff5-36676339d53e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.157941 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dbdfdbbf-0b51-4ec7-bff5-36676339d53e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.159830 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dbdfdbbf-0b51-4ec7-bff5-36676339d53e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.162354 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dbdfdbbf-0b51-4ec7-bff5-36676339d53e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.271577 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2098d077-d3e3-471a-8fb7-62e46eaf3eac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:54.282222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2098d077-d3e3-471a-8fb7-62e46eaf3eac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.228403 Jun 22 09:07:54.283147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 59/106] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:54 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:54.420117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4bf6a341-73f7-4e22-a70b-ab13671d6d26 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:54.420708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4bf6a341-73f7-4e22-a70b-ab13671d6d26 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:54.430900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4bf6a341-73f7-4e22-a70b-ab13671d6d26 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.431976 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4bf6a341-73f7-4e22-a70b-ab13671d6d26 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.432749 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4bf6a341-73f7-4e22-a70b-ab13671d6d26 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.433362 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4bf6a341-73f7-4e22-a70b-ab13671d6d26 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.621292 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-dbdfdbbf-0b51-4ec7-bff5-36676339d53e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:54.625500 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-dbdfdbbf-0b51-4ec7-bff5-36676339d53e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.486541 Jun 22 09:07:54.641378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 48/107] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:54 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:54.707303 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4bf6a341-73f7-4e22-a70b-ab13671d6d26 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:54.723036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4bf6a341-73f7-4e22-a70b-ab13671d6d26 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.306457 Jun 22 09:07:54.737170 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 60/108] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:54 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:55.070682 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a59fe8d9-4eed-4120-8403-76fcfc4b6c68 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:55.071472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a59fe8d9-4eed-4120-8403-76fcfc4b6c68 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:55.083442 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a59fe8d9-4eed-4120-8403-76fcfc4b6c68 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.084650 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a59fe8d9-4eed-4120-8403-76fcfc4b6c68 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.086149 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a59fe8d9-4eed-4120-8403-76fcfc4b6c68 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.087973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a59fe8d9-4eed-4120-8403-76fcfc4b6c68 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.248840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a59fe8d9-4eed-4120-8403-76fcfc4b6c68 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:55.258572 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a59fe8d9-4eed-4120-8403-76fcfc4b6c68 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.194772 Jun 22 09:07:55.258572 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 49/109] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:55 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:55.300613 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2aef3362-03ed-49fe-8400-a8fe474012a6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:55.301239 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2aef3362-03ed-49fe-8400-a8fe474012a6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:55.308297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2aef3362-03ed-49fe-8400-a8fe474012a6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.308822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2aef3362-03ed-49fe-8400-a8fe474012a6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.310237 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2aef3362-03ed-49fe-8400-a8fe474012a6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.310662 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2aef3362-03ed-49fe-8400-a8fe474012a6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.477050 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2aef3362-03ed-49fe-8400-a8fe474012a6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:55.486474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2aef3362-03ed-49fe-8400-a8fe474012a6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.189756 Jun 22 09:07:55.489593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 61/110] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:55 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:55.646487 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-33557e42-08e7-4d54-964c-2a83fb9b34dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:55.647299 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-33557e42-08e7-4d54-964c-2a83fb9b34dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:55.655455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-33557e42-08e7-4d54-964c-2a83fb9b34dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.656039 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-33557e42-08e7-4d54-964c-2a83fb9b34dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.657138 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-33557e42-08e7-4d54-964c-2a83fb9b34dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.657765 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-33557e42-08e7-4d54-964c-2a83fb9b34dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.740002 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cfe602fb-68d7-4c6d-b5a0-a09e522d2dda tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:55.741204 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cfe602fb-68d7-4c6d-b5a0-a09e522d2dda tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:55.756150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cfe602fb-68d7-4c6d-b5a0-a09e522d2dda tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.756150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cfe602fb-68d7-4c6d-b5a0-a09e522d2dda tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.756150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cfe602fb-68d7-4c6d-b5a0-a09e522d2dda tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.756150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cfe602fb-68d7-4c6d-b5a0-a09e522d2dda tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.796279 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-33557e42-08e7-4d54-964c-2a83fb9b34dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:55.815471 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-33557e42-08e7-4d54-964c-2a83fb9b34dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.173818 Jun 22 09:07:55.816058 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 50/111] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:55 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:55.908919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cfe602fb-68d7-4c6d-b5a0-a09e522d2dda tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:55.916793 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cfe602fb-68d7-4c6d-b5a0-a09e522d2dda tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.180910 Jun 22 09:07:55.917933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 62/112] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:55 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:56.086570 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-88a2b701-3e4e-409d-b900-a783237ab07d req-56257b23-56c6-449d-9f88-eaaff7bbfb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1905450d-b26c-4e46-914b-a6a04d9cc7b1", "name": "network-vif-plugged", "status": "completed", "tag": "974e9d62-8fe0-47bd-ad36-3e266d639c90"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:56.133272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-88a2b701-3e4e-409d-b900-a783237ab07d req-56257b23-56c6-449d-9f88-eaaff7bbfb0b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.133706 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-88a2b701-3e4e-409d-b900-a783237ab07d req-56257b23-56c6-449d-9f88-eaaff7bbfb0b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.167487 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-88a2b701-3e4e-409d-b900-a783237ab07d req-56257b23-56c6-449d-9f88-eaaff7bbfb0b service nova] Creating event network-vif-plugged:974e9d62-8fe0-47bd-ad36-3e266d639c90 for instance 1905450d-b26c-4e46-914b-a6a04d9cc7b1 on hv-cinder-80382 Jun 22 09:07:56.180592 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-88a2b701-3e4e-409d-b900-a783237ab07d req-56257b23-56c6-449d-9f88-eaaff7bbfb0b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097537 Jun 22 09:07:56.181215 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 51/113] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:56.273568 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cd157539-8fb7-48d3-904b-5528f5fa252b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:56.274208 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cd157539-8fb7-48d3-904b-5528f5fa252b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:56.290282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cd157539-8fb7-48d3-904b-5528f5fa252b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.290735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cd157539-8fb7-48d3-904b-5528f5fa252b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.291546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cd157539-8fb7-48d3-904b-5528f5fa252b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.291985 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cd157539-8fb7-48d3-904b-5528f5fa252b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.506491 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-99574818-6747-4073-910a-742ee757eed8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:56.507291 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-99574818-6747-4073-910a-742ee757eed8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:56.515795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-99574818-6747-4073-910a-742ee757eed8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.516335 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-99574818-6747-4073-910a-742ee757eed8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.517120 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-99574818-6747-4073-910a-742ee757eed8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.517553 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-99574818-6747-4073-910a-742ee757eed8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.565956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cd157539-8fb7-48d3-904b-5528f5fa252b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:56.580615 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cd157539-8fb7-48d3-904b-5528f5fa252b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.310896 Jun 22 09:07:56.583688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 63/114] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:56 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:56.785537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-99574818-6747-4073-910a-742ee757eed8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:56.789146 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=100 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:56.816096 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-99574818-6747-4073-910a-742ee757eed8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.314795 Jun 22 09:07:56.822621 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 52/115] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:56 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:56.844519 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-681f33c9-6451-4f7f-a9ab-7e1d2a428f02 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:56.844519 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-681f33c9-6451-4f7f-a9ab-7e1d2a428f02 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:56.855914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-681f33c9-6451-4f7f-a9ab-7e1d2a428f02 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.856902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-681f33c9-6451-4f7f-a9ab-7e1d2a428f02 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.857678 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-681f33c9-6451-4f7f-a9ab-7e1d2a428f02 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.863402 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-681f33c9-6451-4f7f-a9ab-7e1d2a428f02 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.942097 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f7b1adab-f1c6-4fde-a9d0-968bc9c071ce tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:56.943036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f7b1adab-f1c6-4fde-a9d0-968bc9c071ce tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:56.968038 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7b1adab-f1c6-4fde-a9d0-968bc9c071ce tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.968496 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7b1adab-f1c6-4fde-a9d0-968bc9c071ce tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.969270 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7b1adab-f1c6-4fde-a9d0-968bc9c071ce tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.969709 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7b1adab-f1c6-4fde-a9d0-968bc9c071ce tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.091471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-681f33c9-6451-4f7f-a9ab-7e1d2a428f02 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:57.100145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-681f33c9-6451-4f7f-a9ab-7e1d2a428f02 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.270980 Jun 22 09:07:57.102664 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 64/116] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:56 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:57.156627 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f7b1adab-f1c6-4fde-a9d0-968bc9c071ce tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:57.164880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f7b1adab-f1c6-4fde-a9d0-968bc9c071ce tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.228262 Jun 22 09:07:57.164880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 53/117] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:56 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:57.598081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b5d6ff04-0e3b-4feb-a0fb-d0d1da1d50ac tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:57.598756 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b5d6ff04-0e3b-4feb-a0fb-d0d1da1d50ac tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:57.606448 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b5d6ff04-0e3b-4feb-a0fb-d0d1da1d50ac tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.607060 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b5d6ff04-0e3b-4feb-a0fb-d0d1da1d50ac tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.607905 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b5d6ff04-0e3b-4feb-a0fb-d0d1da1d50ac tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.608408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b5d6ff04-0e3b-4feb-a0fb-d0d1da1d50ac tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.744040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b5d6ff04-0e3b-4feb-a0fb-d0d1da1d50ac tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:57.752807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b5d6ff04-0e3b-4feb-a0fb-d0d1da1d50ac tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1322 microversion: 2.1 time: 0.158769 Jun 22 09:07:57.753812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 65/118] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:57 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:57.834417 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e11cdf57-5015-4fd3-8a15-a8dd4274392e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:57.835057 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e11cdf57-5015-4fd3-8a15-a8dd4274392e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:57.842046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e11cdf57-5015-4fd3-8a15-a8dd4274392e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.846558 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e11cdf57-5015-4fd3-8a15-a8dd4274392e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.846558 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e11cdf57-5015-4fd3-8a15-a8dd4274392e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.846558 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e11cdf57-5015-4fd3-8a15-a8dd4274392e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.986877 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e11cdf57-5015-4fd3-8a15-a8dd4274392e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:57.994737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e11cdf57-5015-4fd3-8a15-a8dd4274392e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1362 microversion: 2.1 time: 0.164922 Jun 22 09:07:57.995505 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 54/119] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:57 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:58.119559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8cd60d31-6a4f-47bc-bb6e-d98ce2223a01 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:58.120166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8cd60d31-6a4f-47bc-bb6e-d98ce2223a01 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:58.126867 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8cd60d31-6a4f-47bc-bb6e-d98ce2223a01 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.128723 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8cd60d31-6a4f-47bc-bb6e-d98ce2223a01 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.128723 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8cd60d31-6a4f-47bc-bb6e-d98ce2223a01 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.128723 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8cd60d31-6a4f-47bc-bb6e-d98ce2223a01 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.183110 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-128d5e53-6c5d-476f-9e67-63514db53c28 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:58.184791 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-128d5e53-6c5d-476f-9e67-63514db53c28 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:58.192801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-128d5e53-6c5d-476f-9e67-63514db53c28 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.192801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-128d5e53-6c5d-476f-9e67-63514db53c28 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.193120 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-128d5e53-6c5d-476f-9e67-63514db53c28 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.193871 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-128d5e53-6c5d-476f-9e67-63514db53c28 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.272682 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8cd60d31-6a4f-47bc-bb6e-d98ce2223a01 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:58.282270 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8cd60d31-6a4f-47bc-bb6e-d98ce2223a01 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.166484 Jun 22 09:07:58.283165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 66/120] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:58 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:58.288271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-c08ed9bf-bdd4-4696-93e2-762c20cd29be req-c1ee8313-ccf2-43e8-8cf2-da8cb178ef73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ae5dc0-905f-467a-904f-af2631f8e574", "name": "network-vif-plugged", "status": "completed", "tag": "61559b1c-64d4-490b-bed9-7974553e8e11"}, {"server_uuid": "cf015553-3a8f-459a-a15a-f269b6d3dae6", "name": "network-vif-plugged", "status": "completed", "tag": "0ae128fa-373b-4d19-b6a6-ca5d9a45df96"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:58.301813 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-c08ed9bf-bdd4-4696-93e2-762c20cd29be req-c1ee8313-ccf2-43e8-8cf2-da8cb178ef73 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.302475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-c08ed9bf-bdd4-4696-93e2-762c20cd29be req-c1ee8313-ccf2-43e8-8cf2-da8cb178ef73 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.320905 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-c08ed9bf-bdd4-4696-93e2-762c20cd29be req-c1ee8313-ccf2-43e8-8cf2-da8cb178ef73 service nova] Creating event network-vif-plugged:61559b1c-64d4-490b-bed9-7974553e8e11 for instance 13ae5dc0-905f-467a-904f-af2631f8e574 on hv-cinder-80382 Jun 22 09:07:58.322280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-c08ed9bf-bdd4-4696-93e2-762c20cd29be req-c1ee8313-ccf2-43e8-8cf2-da8cb178ef73 service nova] Creating event network-vif-plugged:0ae128fa-373b-4d19-b6a6-ca5d9a45df96 for instance cf015553-3a8f-459a-a15a-f269b6d3dae6 on hv-cinder-80382 Jun 22 09:07:58.329299 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-c08ed9bf-bdd4-4696-93e2-762c20cd29be req-c1ee8313-ccf2-43e8-8cf2-da8cb178ef73 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044599 Jun 22 09:07:58.336773 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 67/121] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:58.374355 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-128d5e53-6c5d-476f-9e67-63514db53c28 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:58.397872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-128d5e53-6c5d-476f-9e67-63514db53c28 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.219612 Jun 22 09:07:58.407979 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 55/122] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:58 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:58.771151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-783c6d32-59a2-48c5-9ebc-a4e38dbaddf6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:58.771934 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-783c6d32-59a2-48c5-9ebc-a4e38dbaddf6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:58.783786 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-783c6d32-59a2-48c5-9ebc-a4e38dbaddf6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.784709 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-783c6d32-59a2-48c5-9ebc-a4e38dbaddf6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.785414 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-783c6d32-59a2-48c5-9ebc-a4e38dbaddf6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.785805 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-783c6d32-59a2-48c5-9ebc-a4e38dbaddf6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.947126 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-783c6d32-59a2-48c5-9ebc-a4e38dbaddf6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:58.955447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-783c6d32-59a2-48c5-9ebc-a4e38dbaddf6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1516 microversion: 2.1 time: 0.188284 Jun 22 09:07:58.956840 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 68/123] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:58 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:58.978497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5e3db8e2-27c7-45dc-8f4c-1ab119160738 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:58.980174 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5e3db8e2-27c7-45dc-8f4c-1ab119160738 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:58.987791 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5e3db8e2-27c7-45dc-8f4c-1ab119160738 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.988404 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5e3db8e2-27c7-45dc-8f4c-1ab119160738 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.989330 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5e3db8e2-27c7-45dc-8f4c-1ab119160738 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.989913 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5e3db8e2-27c7-45dc-8f4c-1ab119160738 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.011480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-97a0d69e-fa6a-4577-9b96-0609eb75f4c0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:59.012107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-97a0d69e-fa6a-4577-9b96-0609eb75f4c0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:59.023455 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-97a0d69e-fa6a-4577-9b96-0609eb75f4c0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.028596 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-97a0d69e-fa6a-4577-9b96-0609eb75f4c0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.028797 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-97a0d69e-fa6a-4577-9b96-0609eb75f4c0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.029249 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-97a0d69e-fa6a-4577-9b96-0609eb75f4c0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.046560 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:59.071447 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-5e3db8e2-27c7-45dc-8f4c-1ab119160738 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lazy-loading 'flavor' on Instance uuid 1905450d-b26c-4e46-914b-a6a04d9cc7b1 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:07:59.237166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-97a0d69e-fa6a-4577-9b96-0609eb75f4c0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:59.246296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-97a0d69e-fa6a-4577-9b96-0609eb75f4c0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1549 microversion: 2.1 time: 0.238701 Jun 22 09:07:59.248215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 69/124] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:59 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1549 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:59.270291 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-548d6da3-5f04-4b02-9774-bd997aa274ac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:59.288505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-548d6da3-5f04-4b02-9774-bd997aa274ac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:59.300502 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-548d6da3-5f04-4b02-9774-bd997aa274ac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.301057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-548d6da3-5f04-4b02-9774-bd997aa274ac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.301854 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-548d6da3-5f04-4b02-9774-bd997aa274ac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.307148 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-548d6da3-5f04-4b02-9774-bd997aa274ac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.507001 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-548d6da3-5f04-4b02-9774-bd997aa274ac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.246635 Jun 22 09:07:59.507679 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 70/125] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 22 09:07:59 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:07:59.514023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-477409f0-9b9d-4540-9885-a83500bf5373 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:59.520532 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-477409f0-9b9d-4540-9885-a83500bf5373 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:59.524932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5e3db8e2-27c7-45dc-8f4c-1ab119160738 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1/action" status: 200 len: 32 microversion: 2.1 time: 0.550960 Jun 22 09:07:59.526005 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 56/126] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:07:58 2022] POST /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:07:59.532643 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-477409f0-9b9d-4540-9885-a83500bf5373 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.537501 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5aee3897-3de0-43e8-839b-85843a4fccd8 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:59.538652 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-477409f0-9b9d-4540-9885-a83500bf5373 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.539740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-477409f0-9b9d-4540-9885-a83500bf5373 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.540468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5aee3897-3de0-43e8-839b-85843a4fccd8 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:59.540685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-477409f0-9b9d-4540-9885-a83500bf5373 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.566145 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5aee3897-3de0-43e8-839b-85843a4fccd8 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.569057 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5aee3897-3de0-43e8-839b-85843a4fccd8 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.572762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5aee3897-3de0-43e8-839b-85843a4fccd8 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.574230 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5aee3897-3de0-43e8-839b-85843a4fccd8 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.825360 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5aee3897-3de0-43e8-839b-85843a4fccd8 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:59.834112 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5aee3897-3de0-43e8-839b-85843a4fccd8 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.306825 Jun 22 09:07:59.834681 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 57/127] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:59 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:59.851710 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6fc25c8c-203f-439d-b7ec-76699cc8fcec tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:59.852578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6fc25c8c-203f-439d-b7ec-76699cc8fcec tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:59.859466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6fc25c8c-203f-439d-b7ec-76699cc8fcec tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.861992 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6fc25c8c-203f-439d-b7ec-76699cc8fcec tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.861992 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6fc25c8c-203f-439d-b7ec-76699cc8fcec tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:59.861992 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6fc25c8c-203f-439d-b7ec-76699cc8fcec tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:59.917825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-477409f0-9b9d-4540-9885-a83500bf5373 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:59.929433 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-477409f0-9b9d-4540-9885-a83500bf5373 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.420298 Jun 22 09:07:59.930024 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 71/128] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:59 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:00.006048 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-6fc25c8c-203f-439d-b7ec-76699cc8fcec tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:00.018249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6fc25c8c-203f-439d-b7ec-76699cc8fcec tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.176766 Jun 22 09:08:00.032807 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 58/129] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:59 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:00.359826 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-e48cec2b-611d-47b1-9101-68a3aa2fcd10 req-d7153b8d-982a-48ce-8180-1e01b64df176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "139fc621-9e20-4f05-9935-92b048cc48a1", "name": "network-vif-plugged", "status": "completed", "tag": "daa50036-a697-4fc0-8fc6-23a1965628ef"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:00.374884 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-e48cec2b-611d-47b1-9101-68a3aa2fcd10 req-d7153b8d-982a-48ce-8180-1e01b64df176 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:00.375567 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-e48cec2b-611d-47b1-9101-68a3aa2fcd10 req-d7153b8d-982a-48ce-8180-1e01b64df176 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:00.389445 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-e48cec2b-611d-47b1-9101-68a3aa2fcd10 req-d7153b8d-982a-48ce-8180-1e01b64df176 service nova] Creating event network-vif-plugged:daa50036-a697-4fc0-8fc6-23a1965628ef for instance 139fc621-9e20-4f05-9935-92b048cc48a1 on hv-cinder-80382 Jun 22 09:08:00.396527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-e48cec2b-611d-47b1-9101-68a3aa2fcd10 req-d7153b8d-982a-48ce-8180-1e01b64df176 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042417 Jun 22 09:08:00.396527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 72/130] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:00.851294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6f009ad6-8895-47e3-ad6b-c18ba43113d5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:00.854189 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6f009ad6-8895-47e3-ad6b-c18ba43113d5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:00.858354 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6f009ad6-8895-47e3-ad6b-c18ba43113d5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:00.858788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6f009ad6-8895-47e3-ad6b-c18ba43113d5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:00.859588 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6f009ad6-8895-47e3-ad6b-c18ba43113d5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:00.860025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6f009ad6-8895-47e3-ad6b-c18ba43113d5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:00.947648 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f5b28096-ff88-4815-9610-faf6f1857ec9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:00.948349 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f5b28096-ff88-4815-9610-faf6f1857ec9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:00.960480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f5b28096-ff88-4815-9610-faf6f1857ec9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:00.960933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f5b28096-ff88-4815-9610-faf6f1857ec9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:00.968826 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f5b28096-ff88-4815-9610-faf6f1857ec9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:00.968826 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f5b28096-ff88-4815-9610-faf6f1857ec9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:01.009598 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-6f009ad6-8895-47e3-ad6b-c18ba43113d5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:01.017577 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6f009ad6-8895-47e3-ad6b-c18ba43113d5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1315 microversion: 2.1 time: 0.170322 Jun 22 09:08:01.018162 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 59/131] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:00 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:01.047802 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a04ce51f-b52f-4642-9af8-ada131bea5ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:01.047802 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a04ce51f-b52f-4642-9af8-ada131bea5ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:01.056343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a04ce51f-b52f-4642-9af8-ada131bea5ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:01.056671 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a04ce51f-b52f-4642-9af8-ada131bea5ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:01.057653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a04ce51f-b52f-4642-9af8-ada131bea5ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:01.058097 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a04ce51f-b52f-4642-9af8-ada131bea5ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:01.216864 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a04ce51f-b52f-4642-9af8-ada131bea5ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:01.224864 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f5b28096-ff88-4815-9610-faf6f1857ec9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:01.228450 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a04ce51f-b52f-4642-9af8-ada131bea5ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.191729 Jun 22 09:08:01.229933 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 60/132] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:01 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:08:01.244974 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f5b28096-ff88-4815-9610-faf6f1857ec9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.301508 Jun 22 09:08:01.250957 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 73/133] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:00 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:08:01.286641 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-faf020aa-913c-4b86-a1a9-d134706b90a4 req-38380437-b198-40fb-8350-7ace2b70b910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a986f8d-3000-440e-b006-4c90b7c765fa", "tag": "c0eb72f1-4dd3-41ec-bab1-7fb490daf290"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:01.295635 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-faf020aa-913c-4b86-a1a9-d134706b90a4 req-38380437-b198-40fb-8350-7ace2b70b910 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:01.296315 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-faf020aa-913c-4b86-a1a9-d134706b90a4 req-38380437-b198-40fb-8350-7ace2b70b910 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:01.308256 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-faf020aa-913c-4b86-a1a9-d134706b90a4 req-38380437-b198-40fb-8350-7ace2b70b910 service nova] Creating event network-changed:c0eb72f1-4dd3-41ec-bab1-7fb490daf290 for instance 7a986f8d-3000-440e-b006-4c90b7c765fa on hv-cinder-80382 Jun 22 09:08:01.314018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-faf020aa-913c-4b86-a1a9-d134706b90a4 req-38380437-b198-40fb-8350-7ace2b70b910 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031333 Jun 22 09:08:01.319142 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 61/134] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:02.034202 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3f3303ce-2693-4248-a54f-40de064d2428 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:02.034851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3f3303ce-2693-4248-a54f-40de064d2428 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:02.040678 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3f3303ce-2693-4248-a54f-40de064d2428 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:02.041120 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3f3303ce-2693-4248-a54f-40de064d2428 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:02.041880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3f3303ce-2693-4248-a54f-40de064d2428 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:02.042312 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3f3303ce-2693-4248-a54f-40de064d2428 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:02.189036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-3f3303ce-2693-4248-a54f-40de064d2428 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:02.196919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3f3303ce-2693-4248-a54f-40de064d2428 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1502 microversion: 2.1 time: 0.166600 Jun 22 09:08:02.198128 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 74/135] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:02 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:02.248061 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6b1f5d10-5c1f-4171-bdc2-3e3586272c3b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:02.248776 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6b1f5d10-5c1f-4171-bdc2-3e3586272c3b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:02.267525 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ee88ff66-0000-4530-be46-1d17e3752120 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:02.267883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b1f5d10-5c1f-4171-bdc2-3e3586272c3b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:02.268620 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b1f5d10-5c1f-4171-bdc2-3e3586272c3b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:02.270053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b1f5d10-5c1f-4171-bdc2-3e3586272c3b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:02.270469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ee88ff66-0000-4530-be46-1d17e3752120 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:02.271425 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b1f5d10-5c1f-4171-bdc2-3e3586272c3b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:02.276905 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ee88ff66-0000-4530-be46-1d17e3752120 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:02.277357 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ee88ff66-0000-4530-be46-1d17e3752120 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:02.278745 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ee88ff66-0000-4530-be46-1d17e3752120 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:02.279198 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ee88ff66-0000-4530-be46-1d17e3752120 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:02.510070 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-6b1f5d10-5c1f-4171-bdc2-3e3586272c3b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:02.528151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ee88ff66-0000-4530-be46-1d17e3752120 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:02.533061 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6b1f5d10-5c1f-4171-bdc2-3e3586272c3b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.290052 Jun 22 09:08:02.534206 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 62/136] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:02 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:02.551856 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ee88ff66-0000-4530-be46-1d17e3752120 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.290383 Jun 22 09:08:02.553065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 75/137] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:02 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:03.551896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b222b790-a877-4486-a552-b9da3023778a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:03.556848 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b222b790-a877-4486-a552-b9da3023778a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:03.562282 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b222b790-a877-4486-a552-b9da3023778a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:03.562839 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b222b790-a877-4486-a552-b9da3023778a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:03.563864 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b222b790-a877-4486-a552-b9da3023778a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:03.570076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-33aea84d-b0bf-42c2-a195-e3fc0872d204 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:03.571359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-33aea84d-b0bf-42c2-a195-e3fc0872d204 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:03.577114 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b222b790-a877-4486-a552-b9da3023778a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:03.581235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-33aea84d-b0bf-42c2-a195-e3fc0872d204 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:03.581889 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-33aea84d-b0bf-42c2-a195-e3fc0872d204 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:03.598423 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-33aea84d-b0bf-42c2-a195-e3fc0872d204 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:03.601076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-33aea84d-b0bf-42c2-a195-e3fc0872d204 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:03.743959 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b222b790-a877-4486-a552-b9da3023778a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:03.751586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b222b790-a877-4486-a552-b9da3023778a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.204732 Jun 22 09:08:03.752161 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 63/138] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:03 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:03.791164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-33aea84d-b0bf-42c2-a195-e3fc0872d204 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:03.795817 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-33aea84d-b0bf-42c2-a195-e3fc0872d204 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.229899 Jun 22 09:08:03.796499 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 76/139] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:03 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:04.770156 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-335d8e6c-66c5-4c14-b7ac-460e2ceb960e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:04.771003 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-335d8e6c-66c5-4c14-b7ac-460e2ceb960e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:04.777025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-335d8e6c-66c5-4c14-b7ac-460e2ceb960e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:04.777973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-335d8e6c-66c5-4c14-b7ac-460e2ceb960e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:04.778961 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-335d8e6c-66c5-4c14-b7ac-460e2ceb960e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:04.779386 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-335d8e6c-66c5-4c14-b7ac-460e2ceb960e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:04.817108 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a0e9f8e6-a59a-4a3d-a0e4-90985d4eca7b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:04.817687 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a0e9f8e6-a59a-4a3d-a0e4-90985d4eca7b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:04.823875 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a0e9f8e6-a59a-4a3d-a0e4-90985d4eca7b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:04.824475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a0e9f8e6-a59a-4a3d-a0e4-90985d4eca7b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:04.825228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a0e9f8e6-a59a-4a3d-a0e4-90985d4eca7b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:04.825654 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a0e9f8e6-a59a-4a3d-a0e4-90985d4eca7b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:04.923666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-335d8e6c-66c5-4c14-b7ac-460e2ceb960e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:04.932462 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-335d8e6c-66c5-4c14-b7ac-460e2ceb960e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.166056 Jun 22 09:08:04.942776 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 64/140] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:04 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:04.971229 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a0e9f8e6-a59a-4a3d-a0e4-90985d4eca7b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:04.983203 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a0e9f8e6-a59a-4a3d-a0e4-90985d4eca7b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1366 microversion: 2.1 time: 0.169238 Jun 22 09:08:04.983203 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 77/141] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:04 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:05.239427 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-19000c42-767b-4c7c-b20e-e2113f9fcf05 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb3bee36-7d30-4141-b3c7-1bd82dbbc103"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:05.240529 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-19000c42-767b-4c7c-b20e-e2113f9fcf05 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:05.246928 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-19000c42-767b-4c7c-b20e-e2113f9fcf05 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:05.247559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-19000c42-767b-4c7c-b20e-e2113f9fcf05 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:05.251556 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-19000c42-767b-4c7c-b20e-e2113f9fcf05 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:05.251556 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-19000c42-767b-4c7c-b20e-e2113f9fcf05 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:05.949843 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c82b8c46-37e4-4e5f-b7e0-5de9e7710844 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:05.950432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c82b8c46-37e4-4e5f-b7e0-5de9e7710844 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:05.959308 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c82b8c46-37e4-4e5f-b7e0-5de9e7710844 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:05.959981 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c82b8c46-37e4-4e5f-b7e0-5de9e7710844 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:05.960923 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c82b8c46-37e4-4e5f-b7e0-5de9e7710844 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:05.961508 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c82b8c46-37e4-4e5f-b7e0-5de9e7710844 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:06.100929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c82b8c46-37e4-4e5f-b7e0-5de9e7710844 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:06.110175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c82b8c46-37e4-4e5f-b7e0-5de9e7710844 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.164586 Jun 22 09:08:06.110744 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 78/142] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:05 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:08:06.115811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-45f4380f-bfcc-4f52-bfff-704fbae1a657 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:06.116456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-45f4380f-bfcc-4f52-bfff-704fbae1a657 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:06.122044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45f4380f-bfcc-4f52-bfff-704fbae1a657 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:06.122482 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45f4380f-bfcc-4f52-bfff-704fbae1a657 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:06.123947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45f4380f-bfcc-4f52-bfff-704fbae1a657 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:06.123947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45f4380f-bfcc-4f52-bfff-704fbae1a657 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:06.247770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-19000c42-767b-4c7c-b20e-e2113f9fcf05 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "POST /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.012031 Jun 22 09:08:06.249966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 65/143] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:08:05 2022] POST /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574/os-volume_attachments => generated 194 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:06.258223 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-45f4380f-bfcc-4f52-bfff-704fbae1a657 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:06.267474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-45f4380f-bfcc-4f52-bfff-704fbae1a657 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1556 microversion: 2.1 time: 0.155639 Jun 22 09:08:06.268621 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 79/144] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:06 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:06.286147 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f535d935-9a25-4597-9e91-94420305e479 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:06.286981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f535d935-9a25-4597-9e91-94420305e479 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:06.293753 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f535d935-9a25-4597-9e91-94420305e479 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:06.294378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f535d935-9a25-4597-9e91-94420305e479 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:06.295336 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f535d935-9a25-4597-9e91-94420305e479 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:06.295763 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f535d935-9a25-4597-9e91-94420305e479 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:06.384877 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f535d935-9a25-4597-9e91-94420305e479 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102818 Jun 22 09:08:06.385473 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 66/145] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 22 09:08:06 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:07.127791 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-73d7a41e-57ae-43ef-8b56-8b6ad639703d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:07.128512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-73d7a41e-57ae-43ef-8b56-8b6ad639703d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:07.134854 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-73d7a41e-57ae-43ef-8b56-8b6ad639703d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:07.135430 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-73d7a41e-57ae-43ef-8b56-8b6ad639703d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:07.136300 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-73d7a41e-57ae-43ef-8b56-8b6ad639703d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:07.137554 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-73d7a41e-57ae-43ef-8b56-8b6ad639703d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:07.297553 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-73d7a41e-57ae-43ef-8b56-8b6ad639703d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:07.305415 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-73d7a41e-57ae-43ef-8b56-8b6ad639703d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.181622 Jun 22 09:08:07.305999 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 80/146] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:07 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:07.881114 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-26d94745-9122-4df1-be00-d4906633d9ef req-5d305cb2-7d0f-407f-a8b1-49b9ffb7c598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "139fc621-9e20-4f05-9935-92b048cc48a1", "tag": "daa50036-a697-4fc0-8fc6-23a1965628ef"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:07.890099 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=95 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:07.893287 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-26d94745-9122-4df1-be00-d4906633d9ef req-5d305cb2-7d0f-407f-a8b1-49b9ffb7c598 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:07.893759 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-26d94745-9122-4df1-be00-d4906633d9ef req-5d305cb2-7d0f-407f-a8b1-49b9ffb7c598 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:07.906174 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:07.908690 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-26d94745-9122-4df1-be00-d4906633d9ef req-5d305cb2-7d0f-407f-a8b1-49b9ffb7c598 service nova] Creating event network-changed:daa50036-a697-4fc0-8fc6-23a1965628ef for instance 139fc621-9e20-4f05-9935-92b048cc48a1 on hv-cinder-80382 Jun 22 09:08:07.913917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-26d94745-9122-4df1-be00-d4906633d9ef req-5d305cb2-7d0f-407f-a8b1-49b9ffb7c598 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037492 Jun 22 09:08:07.914566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 67/147] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:08.323606 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-762e8202-1e18-4121-a16d-25f5cea63465 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:08.325454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-762e8202-1e18-4121-a16d-25f5cea63465 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:08.342909 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-762e8202-1e18-4121-a16d-25f5cea63465 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:08.343564 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-762e8202-1e18-4121-a16d-25f5cea63465 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:08.344539 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-762e8202-1e18-4121-a16d-25f5cea63465 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:08.345876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-762e8202-1e18-4121-a16d-25f5cea63465 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:08.586293 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-762e8202-1e18-4121-a16d-25f5cea63465 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:08.598230 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-762e8202-1e18-4121-a16d-25f5cea63465 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.275185 Jun 22 09:08:08.598230 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 81/148] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:08 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:09.614251 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b4fbad10-3ab6-482e-815e-e0f3f2500183 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:09.615124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b4fbad10-3ab6-482e-815e-e0f3f2500183 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:09.622775 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b4fbad10-3ab6-482e-815e-e0f3f2500183 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:09.629148 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b4fbad10-3ab6-482e-815e-e0f3f2500183 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:09.629148 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b4fbad10-3ab6-482e-815e-e0f3f2500183 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:09.629148 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b4fbad10-3ab6-482e-815e-e0f3f2500183 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:09.843050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b4fbad10-3ab6-482e-815e-e0f3f2500183 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:09.851621 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b4fbad10-3ab6-482e-815e-e0f3f2500183 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.241844 Jun 22 09:08:09.862959 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 68/149] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:09 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:10.871222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7eac437e-88d4-46e1-814e-5453911f45a0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:10.871222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7eac437e-88d4-46e1-814e-5453911f45a0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:10.875850 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eac437e-88d4-46e1-814e-5453911f45a0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:10.876290 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eac437e-88d4-46e1-814e-5453911f45a0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:10.877114 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eac437e-88d4-46e1-814e-5453911f45a0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:10.877489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eac437e-88d4-46e1-814e-5453911f45a0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:11.047510 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7eac437e-88d4-46e1-814e-5453911f45a0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:11.055500 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7eac437e-88d4-46e1-814e-5453911f45a0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.190135 Jun 22 09:08:11.056082 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 82/150] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:10 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:12.072330 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e76c41f5-b789-4810-81f4-94e9a1eec032 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:12.072923 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e76c41f5-b789-4810-81f4-94e9a1eec032 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:12.080387 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e76c41f5-b789-4810-81f4-94e9a1eec032 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:12.082867 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e76c41f5-b789-4810-81f4-94e9a1eec032 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:12.082867 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e76c41f5-b789-4810-81f4-94e9a1eec032 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:12.082867 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e76c41f5-b789-4810-81f4-94e9a1eec032 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:12.234875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e76c41f5-b789-4810-81f4-94e9a1eec032 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:12.242946 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e76c41f5-b789-4810-81f4-94e9a1eec032 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.174395 Jun 22 09:08:12.243603 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 69/151] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:12 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:13.260104 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c38bc143-90c6-44e5-aabf-19d1cdfbbd89 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:13.261973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c38bc143-90c6-44e5-aabf-19d1cdfbbd89 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:13.271614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c38bc143-90c6-44e5-aabf-19d1cdfbbd89 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:13.271614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c38bc143-90c6-44e5-aabf-19d1cdfbbd89 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:13.275148 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c38bc143-90c6-44e5-aabf-19d1cdfbbd89 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:13.275888 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c38bc143-90c6-44e5-aabf-19d1cdfbbd89 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:13.483149 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c38bc143-90c6-44e5-aabf-19d1cdfbbd89 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:13.498074 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c38bc143-90c6-44e5-aabf-19d1cdfbbd89 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.242105 Jun 22 09:08:13.498667 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 83/152] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:13 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:14.516454 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d05c3ff0-41eb-4c8e-97d1-16d819a0a4aa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:14.517158 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d05c3ff0-41eb-4c8e-97d1-16d819a0a4aa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:14.525108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d05c3ff0-41eb-4c8e-97d1-16d819a0a4aa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:14.525548 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d05c3ff0-41eb-4c8e-97d1-16d819a0a4aa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:14.526675 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d05c3ff0-41eb-4c8e-97d1-16d819a0a4aa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:14.527149 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d05c3ff0-41eb-4c8e-97d1-16d819a0a4aa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:14.669426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d05c3ff0-41eb-4c8e-97d1-16d819a0a4aa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:14.676930 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d05c3ff0-41eb-4c8e-97d1-16d819a0a4aa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.165361 Jun 22 09:08:14.677505 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 70/153] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:14 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:15.694157 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cc124cd5-94cf-453f-a703-78c95028d932 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:15.694689 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cc124cd5-94cf-453f-a703-78c95028d932 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:15.696642 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=85 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:15.701859 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cc124cd5-94cf-453f-a703-78c95028d932 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:15.702429 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cc124cd5-94cf-453f-a703-78c95028d932 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:15.703245 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cc124cd5-94cf-453f-a703-78c95028d932 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:15.703667 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cc124cd5-94cf-453f-a703-78c95028d932 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:15.868506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cc124cd5-94cf-453f-a703-78c95028d932 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:15.876176 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cc124cd5-94cf-453f-a703-78c95028d932 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.186417 Jun 22 09:08:15.876764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 84/154] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:15 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:16.297318 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5f2e0bb5-b686-48d4-8407-18a6ae3564e2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:16.297784 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5f2e0bb5-b686-48d4-8407-18a6ae3564e2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:16.304492 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5f2e0bb5-b686-48d4-8407-18a6ae3564e2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:16.304932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5f2e0bb5-b686-48d4-8407-18a6ae3564e2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:16.305684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5f2e0bb5-b686-48d4-8407-18a6ae3564e2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:16.306109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5f2e0bb5-b686-48d4-8407-18a6ae3564e2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:16.339428 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5f2e0bb5-b686-48d4-8407-18a6ae3564e2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:08:16.684063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5f2e0bb5-b686-48d4-8407-18a6ae3564e2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "DELETE /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 204 len: 0 microversion: 2.1 time: 0.389554 Jun 22 09:08:16.684742 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 71/155] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:08:16 2022] DELETE /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:08:16.692660 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6d42ca43-6466-49ff-b7ff-c7bd9e77d7d2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:16.693263 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6d42ca43-6466-49ff-b7ff-c7bd9e77d7d2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:16.699641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d42ca43-6466-49ff-b7ff-c7bd9e77d7d2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:16.700246 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d42ca43-6466-49ff-b7ff-c7bd9e77d7d2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:16.700823 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d42ca43-6466-49ff-b7ff-c7bd9e77d7d2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:16.701251 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d42ca43-6466-49ff-b7ff-c7bd9e77d7d2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:16.737872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-568607075", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "networks": [{"uuid": "2f01d4cf-c4d9-425d-9769-cc3409305f79"}]}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:16.809835 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] validate_networks() for [('2f01d4cf-c4d9-425d-9769-cc3409305f79', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:08:16.848078 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6d42ca43-6466-49ff-b7ff-c7bd9e77d7d2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:16.857865 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6d42ca43-6466-49ff-b7ff-c7bd9e77d7d2 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1554 microversion: 2.1 time: 0.168991 Jun 22 09:08:16.858811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 85/156] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:16 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:16.895548 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5ddefac5-82dc-4dcb-9d0b-d557fb494ae3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:16.896473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5ddefac5-82dc-4dcb-9d0b-d557fb494ae3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:16.906524 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5ddefac5-82dc-4dcb-9d0b-d557fb494ae3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:16.907153 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5ddefac5-82dc-4dcb-9d0b-d557fb494ae3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:16.908076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5ddefac5-82dc-4dcb-9d0b-d557fb494ae3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:16.908723 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5ddefac5-82dc-4dcb-9d0b-d557fb494ae3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:17.055736 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5ddefac5-82dc-4dcb-9d0b-d557fb494ae3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:17.062132 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:17.069203 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5ddefac5-82dc-4dcb-9d0b-d557fb494ae3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.179752 Jun 22 09:08:17.070628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 86/157] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:16 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:08:17.413961 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:08:17.414401 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:08:17.414850 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:08:17.415249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:08:17.415653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:08:17.425335 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:17.425781 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:17.430324 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:17.430324 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:17.449955 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Getting quotas for project 05bd1375c6784f58a77c9b508ff282c9. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:08:17.453898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Getting quotas for user 4468a51c478d4fd38f2bc3066dff63ff and project 05bd1375c6784f58a77c9b508ff282c9. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:08:17.465066 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:08:17.467403 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:08:17.553309 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b9a02a70-7c27-4c87-8aba-370d030ab9d3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819522 Jun 22 09:08:17.554557 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 72/158] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 09:08:17.564750 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6945dc5c-cd05-4c33-a124-3559ba4b2a39 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:17.565352 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6945dc5c-cd05-4c33-a124-3559ba4b2a39 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:17.646641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6945dc5c-cd05-4c33-a124-3559ba4b2a39 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:17.654411 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6945dc5c-cd05-4c33-a124-3559ba4b2a39 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1218 microversion: 2.1 time: 0.093350 Jun 22 09:08:17.664268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 87/159] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:17 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:17.875635 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7ee1400c-e63c-401c-8b47-d76863e16835 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:17.876395 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7ee1400c-e63c-401c-8b47-d76863e16835 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:17.882651 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7ee1400c-e63c-401c-8b47-d76863e16835 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:17.883183 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7ee1400c-e63c-401c-8b47-d76863e16835 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:17.883951 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7ee1400c-e63c-401c-8b47-d76863e16835 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:17.884386 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7ee1400c-e63c-401c-8b47-d76863e16835 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:18.020708 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7ee1400c-e63c-401c-8b47-d76863e16835 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:18.029046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7ee1400c-e63c-401c-8b47-d76863e16835 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1554 microversion: 2.1 time: 0.157284 Jun 22 09:08:18.029624 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 73/160] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:17 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:18.087121 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7c32fdbd-a97d-45e9-a17e-99c9a10e4c14 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:18.088311 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7c32fdbd-a97d-45e9-a17e-99c9a10e4c14 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:18.094481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7c32fdbd-a97d-45e9-a17e-99c9a10e4c14 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:18.095034 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7c32fdbd-a97d-45e9-a17e-99c9a10e4c14 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:18.095805 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7c32fdbd-a97d-45e9-a17e-99c9a10e4c14 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:18.096413 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7c32fdbd-a97d-45e9-a17e-99c9a10e4c14 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:18.231853 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7c32fdbd-a97d-45e9-a17e-99c9a10e4c14 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:18.248075 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7c32fdbd-a97d-45e9-a17e-99c9a10e4c14 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.164635 Jun 22 09:08:18.248657 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 88/161] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:18 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:18.671563 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-471f2ab6-a8ff-4b36-8566-9fcb5b9c0728 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:18.672183 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-471f2ab6-a8ff-4b36-8566-9fcb5b9c0728 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:18.742385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-471f2ab6-a8ff-4b36-8566-9fcb5b9c0728 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:18.742385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-471f2ab6-a8ff-4b36-8566-9fcb5b9c0728 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1218 microversion: 2.1 time: 0.073647 Jun 22 09:08:18.742385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 74/162] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:18 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:19.045544 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a54e8696-c894-4fc9-8cca-c9b490e314db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:19.046364 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a54e8696-c894-4fc9-8cca-c9b490e314db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:19.052312 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a54e8696-c894-4fc9-8cca-c9b490e314db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:19.052780 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a54e8696-c894-4fc9-8cca-c9b490e314db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:19.053537 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a54e8696-c894-4fc9-8cca-c9b490e314db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:19.053968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a54e8696-c894-4fc9-8cca-c9b490e314db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:19.184643 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a54e8696-c894-4fc9-8cca-c9b490e314db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:19.192461 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a54e8696-c894-4fc9-8cca-c9b490e314db tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1554 microversion: 2.1 time: 0.150859 Jun 22 09:08:19.193021 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 89/163] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:19 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:19.266257 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-afe64138-57c6-43d0-ac82-6589a38bd36a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:19.267237 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-afe64138-57c6-43d0-ac82-6589a38bd36a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:19.274392 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afe64138-57c6-43d0-ac82-6589a38bd36a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:19.275382 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afe64138-57c6-43d0-ac82-6589a38bd36a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:19.275869 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afe64138-57c6-43d0-ac82-6589a38bd36a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:19.276561 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afe64138-57c6-43d0-ac82-6589a38bd36a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:19.408342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-afe64138-57c6-43d0-ac82-6589a38bd36a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:19.415743 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-afe64138-57c6-43d0-ac82-6589a38bd36a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.153657 Jun 22 09:08:19.416301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 75/164] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:19 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:19.758221 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b0bb473a-8c53-47f0-b39c-fcf7b88a75e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:19.759608 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b0bb473a-8c53-47f0-b39c-fcf7b88a75e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:19.767201 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0bb473a-8c53-47f0-b39c-fcf7b88a75e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:19.767762 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0bb473a-8c53-47f0-b39c-fcf7b88a75e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:19.768590 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0bb473a-8c53-47f0-b39c-fcf7b88a75e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:19.769259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0bb473a-8c53-47f0-b39c-fcf7b88a75e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:19.836654 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b0bb473a-8c53-47f0-b39c-fcf7b88a75e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:19.844866 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b0bb473a-8c53-47f0-b39c-fcf7b88a75e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1214 microversion: 2.1 time: 0.091114 Jun 22 09:08:19.845444 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 90/165] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:19 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:20.158723 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-e2416bf2-73bb-4092-88f8-f7477e96d41b req-0054b664-98f3-4d77-b007-627003375514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ae5dc0-905f-467a-904f-af2631f8e574", "name": "network-vif-deleted", "tag": "61559b1c-64d4-490b-bed9-7974553e8e11"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:20.167881 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-e2416bf2-73bb-4092-88f8-f7477e96d41b req-0054b664-98f3-4d77-b007-627003375514 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:20.168317 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-e2416bf2-73bb-4092-88f8-f7477e96d41b req-0054b664-98f3-4d77-b007-627003375514 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:20.185342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-e2416bf2-73bb-4092-88f8-f7477e96d41b req-0054b664-98f3-4d77-b007-627003375514 service nova] Creating event network-vif-deleted:61559b1c-64d4-490b-bed9-7974553e8e11 for instance 13ae5dc0-905f-467a-904f-af2631f8e574 on hv-cinder-80382 Jun 22 09:08:20.190762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-e2416bf2-73bb-4092-88f8-f7477e96d41b req-0054b664-98f3-4d77-b007-627003375514 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035698 Jun 22 09:08:20.191754 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 76/166] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:20.210662 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5f293040-56d7-4e16-9f2c-532b23b07351 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:20.211472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5f293040-56d7-4e16-9f2c-532b23b07351 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:20.219420 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5f293040-56d7-4e16-9f2c-532b23b07351 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:20.219938 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5f293040-56d7-4e16-9f2c-532b23b07351 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:20.220788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5f293040-56d7-4e16-9f2c-532b23b07351 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:20.221281 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5f293040-56d7-4e16-9f2c-532b23b07351 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:20.292364 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5f293040-56d7-4e16-9f2c-532b23b07351 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:20.309257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5f293040-56d7-4e16-9f2c-532b23b07351 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1512 microversion: 2.1 time: 0.102066 Jun 22 09:08:20.310354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 91/167] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:20 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1512 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:20.434500 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b4713546-4908-4536-aa0e-9dac441fac12 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:20.435326 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b4713546-4908-4536-aa0e-9dac441fac12 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:20.443230 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b4713546-4908-4536-aa0e-9dac441fac12 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:20.443825 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b4713546-4908-4536-aa0e-9dac441fac12 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:20.444973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b4713546-4908-4536-aa0e-9dac441fac12 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:20.445460 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b4713546-4908-4536-aa0e-9dac441fac12 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:20.665724 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b4713546-4908-4536-aa0e-9dac441fac12 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:20.674232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b4713546-4908-4536-aa0e-9dac441fac12 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.244733 Jun 22 09:08:20.675367 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 77/168] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:20 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:20.862264 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9b3b5765-a46d-460a-a831-7df7db2e4715 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:20.862909 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9b3b5765-a46d-460a-a831-7df7db2e4715 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:20.869169 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9b3b5765-a46d-460a-a831-7df7db2e4715 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:20.869438 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9b3b5765-a46d-460a-a831-7df7db2e4715 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:20.870181 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9b3b5765-a46d-460a-a831-7df7db2e4715 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:20.871282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9b3b5765-a46d-460a-a831-7df7db2e4715 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:20.935359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9b3b5765-a46d-460a-a831-7df7db2e4715 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:20.942765 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9b3b5765-a46d-460a-a831-7df7db2e4715 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1288 microversion: 2.1 time: 0.084487 Jun 22 09:08:20.945369 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 92/169] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:20 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:21.336030 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-59d85755-d54e-4023-b540-1c08389e50c4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:21.336628 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-59d85755-d54e-4023-b540-1c08389e50c4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:21.347307 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59d85755-d54e-4023-b540-1c08389e50c4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:21.347307 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59d85755-d54e-4023-b540-1c08389e50c4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:21.347307 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59d85755-d54e-4023-b540-1c08389e50c4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:21.347307 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59d85755-d54e-4023-b540-1c08389e50c4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:21.415449 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-59d85755-d54e-4023-b540-1c08389e50c4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:21.424896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-59d85755-d54e-4023-b540-1c08389e50c4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1346 microversion: 2.1 time: 0.094406 Jun 22 09:08:21.425688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 78/170] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:21 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:21.692639 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4f123015-7134-4e2b-b64c-29d5040054e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:21.693250 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4f123015-7134-4e2b-b64c-29d5040054e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:21.699844 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f123015-7134-4e2b-b64c-29d5040054e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:21.700284 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f123015-7134-4e2b-b64c-29d5040054e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:21.701033 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f123015-7134-4e2b-b64c-29d5040054e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:21.701464 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f123015-7134-4e2b-b64c-29d5040054e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:21.827055 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4f123015-7134-4e2b-b64c-29d5040054e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:21.834565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4f123015-7134-4e2b-b64c-29d5040054e2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.145778 Jun 22 09:08:21.835236 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 93/171] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:21 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:21.959783 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e9262824-c765-4079-ba97-ff3c45b1f839 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:21.960313 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e9262824-c765-4079-ba97-ff3c45b1f839 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:21.967601 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e9262824-c765-4079-ba97-ff3c45b1f839 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:21.967601 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e9262824-c765-4079-ba97-ff3c45b1f839 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:21.967601 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e9262824-c765-4079-ba97-ff3c45b1f839 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:21.967863 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e9262824-c765-4079-ba97-ff3c45b1f839 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:22.123300 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e9262824-c765-4079-ba97-ff3c45b1f839 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:22.130783 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e9262824-c765-4079-ba97-ff3c45b1f839 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.175012 Jun 22 09:08:22.131377 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 79/172] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:21 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:22.441441 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-22273c64-e79c-4d76-bda2-710a3131df03 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:22.442182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-22273c64-e79c-4d76-bda2-710a3131df03 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:22.448237 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-22273c64-e79c-4d76-bda2-710a3131df03 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:22.449265 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-22273c64-e79c-4d76-bda2-710a3131df03 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:22.450087 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-22273c64-e79c-4d76-bda2-710a3131df03 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:22.450592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-22273c64-e79c-4d76-bda2-710a3131df03 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:22.510483 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-22273c64-e79c-4d76-bda2-710a3131df03 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:22.518960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-22273c64-e79c-4d76-bda2-710a3131df03 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1346 microversion: 2.1 time: 0.081413 Jun 22 09:08:22.519517 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 94/173] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:22 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:22.852820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d2ec0a8a-1251-47e6-ae83-d4eb9bc47447 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:22.853424 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d2ec0a8a-1251-47e6-ae83-d4eb9bc47447 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:22.860109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d2ec0a8a-1251-47e6-ae83-d4eb9bc47447 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:22.860557 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d2ec0a8a-1251-47e6-ae83-d4eb9bc47447 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:22.861368 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d2ec0a8a-1251-47e6-ae83-d4eb9bc47447 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:22.861833 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d2ec0a8a-1251-47e6-ae83-d4eb9bc47447 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:22.993851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d2ec0a8a-1251-47e6-ae83-d4eb9bc47447 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:23.001920 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d2ec0a8a-1251-47e6-ae83-d4eb9bc47447 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.153294 Jun 22 09:08:23.005347 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 80/174] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:22 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:23.147834 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1bcc5df9-1d7e-46de-b014-cdf5fd825dfb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:23.151667 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1bcc5df9-1d7e-46de-b014-cdf5fd825dfb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:23.154299 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bcc5df9-1d7e-46de-b014-cdf5fd825dfb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:23.154935 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bcc5df9-1d7e-46de-b014-cdf5fd825dfb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:23.155684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bcc5df9-1d7e-46de-b014-cdf5fd825dfb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:23.156105 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bcc5df9-1d7e-46de-b014-cdf5fd825dfb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:23.281007 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1bcc5df9-1d7e-46de-b014-cdf5fd825dfb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:23.288572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1bcc5df9-1d7e-46de-b014-cdf5fd825dfb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.144502 Jun 22 09:08:23.289138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 95/175] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:23 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:23.538966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c63b092a-c690-44fd-9d7c-3a5b4bc299c5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:23.539731 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c63b092a-c690-44fd-9d7c-3a5b4bc299c5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:23.552819 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c63b092a-c690-44fd-9d7c-3a5b4bc299c5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:23.553441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c63b092a-c690-44fd-9d7c-3a5b4bc299c5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:23.554683 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c63b092a-c690-44fd-9d7c-3a5b4bc299c5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:23.555310 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c63b092a-c690-44fd-9d7c-3a5b4bc299c5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:23.660882 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c63b092a-c690-44fd-9d7c-3a5b4bc299c5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:23.670154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c63b092a-c690-44fd-9d7c-3a5b4bc299c5 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1346 microversion: 2.1 time: 0.137560 Jun 22 09:08:23.671247 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 81/176] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:23 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:24.021101 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5230c17d-5f76-4872-9314-f35c272e730c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:24.021909 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5230c17d-5f76-4872-9314-f35c272e730c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:24.028227 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5230c17d-5f76-4872-9314-f35c272e730c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.028680 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5230c17d-5f76-4872-9314-f35c272e730c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.030444 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5230c17d-5f76-4872-9314-f35c272e730c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.030444 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5230c17d-5f76-4872-9314-f35c272e730c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.196675 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5230c17d-5f76-4872-9314-f35c272e730c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:24.207271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5230c17d-5f76-4872-9314-f35c272e730c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.190336 Jun 22 09:08:24.207943 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 96/177] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:24 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:24.308751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b791bdb6-8834-4c06-8e9b-5e56f31220df tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:24.309492 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b791bdb6-8834-4c06-8e9b-5e56f31220df tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:24.315707 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b791bdb6-8834-4c06-8e9b-5e56f31220df tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.316148 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b791bdb6-8834-4c06-8e9b-5e56f31220df tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.316976 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b791bdb6-8834-4c06-8e9b-5e56f31220df tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.317401 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b791bdb6-8834-4c06-8e9b-5e56f31220df tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.404412 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-a793e279-91fa-4d3a-a24d-c48ab15aca19 req-0e50e296-4acd-4a02-8865-c20343f08461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e81493b-721d-4eff-a43f-85d2b26c3e25", "tag": "4aca7fad-7c3e-433c-a3a4-675450c7a2d2"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:24.413472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-a793e279-91fa-4d3a-a24d-c48ab15aca19 req-0e50e296-4acd-4a02-8865-c20343f08461 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.413991 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-a793e279-91fa-4d3a-a24d-c48ab15aca19 req-0e50e296-4acd-4a02-8865-c20343f08461 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.426701 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-a793e279-91fa-4d3a-a24d-c48ab15aca19 req-0e50e296-4acd-4a02-8865-c20343f08461 service nova] Creating event network-changed:4aca7fad-7c3e-433c-a3a4-675450c7a2d2 for instance 0e81493b-721d-4eff-a43f-85d2b26c3e25 on hv-cinder-80382 Jun 22 09:08:24.431955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-a793e279-91fa-4d3a-a24d-c48ab15aca19 req-0e50e296-4acd-4a02-8865-c20343f08461 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032316 Jun 22 09:08:24.433272 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 97/178] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:08:24.484829 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b791bdb6-8834-4c06-8e9b-5e56f31220df tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:24.492386 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b791bdb6-8834-4c06-8e9b-5e56f31220df tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.187737 Jun 22 09:08:24.492948 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 82/179] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:24 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:24.688656 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:24.692023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:24.695818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.696352 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.697106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.697541 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.731535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.731984 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.732781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lazy-loading 'fault' on Instance uuid 13ae5dc0-905f-467a-904f-af2631f8e574 {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:08:24.795315 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8cc558dee74179b538f20c1b90f44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e06efd9f018749e3931f713b485d6f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:24.803595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a65fac6b-865d-40c7-83a9-190bc848c4ac tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 200 len: 1351 microversion: 2.1 time: 0.119165 Jun 22 09:08:24.804173 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 98/180] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:24 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:25.224621 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d08dafad-7605-4849-befc-ff6f600d2e07 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:25.225356 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d08dafad-7605-4849-befc-ff6f600d2e07 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:25.232428 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08dafad-7605-4849-befc-ff6f600d2e07 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.232966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08dafad-7605-4849-befc-ff6f600d2e07 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.233804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08dafad-7605-4849-befc-ff6f600d2e07 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.235099 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08dafad-7605-4849-befc-ff6f600d2e07 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.447643 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d08dafad-7605-4849-befc-ff6f600d2e07 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:25.455694 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d08dafad-7605-4849-befc-ff6f600d2e07 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.235087 Jun 22 09:08:25.462185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 83/181] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:25 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:25.508799 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-88964594-0693-4d01-9a81-710a02780792 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:25.509411 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-88964594-0693-4d01-9a81-710a02780792 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:25.515256 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-88964594-0693-4d01-9a81-710a02780792 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.516199 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-88964594-0693-4d01-9a81-710a02780792 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.516956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-88964594-0693-4d01-9a81-710a02780792 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.517382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-88964594-0693-4d01-9a81-710a02780792 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.657183 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-88964594-0693-4d01-9a81-710a02780792 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:25.664576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-88964594-0693-4d01-9a81-710a02780792 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.159958 Jun 22 09:08:25.665131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 99/182] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:25 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:25.825403 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:25.825944 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:25.831951 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.832394 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.833142 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.833573 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.847404 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] HTTP exception thrown: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Request method failure captured: Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 HTTP/1.1 Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvJHBlEkBzkObMWpAs2-MWHYG6QNFXil1TKyLI4a4gOYGmZeSW_37TCslc_uPYNd7rkKcWMzsa_z36_rGXSqCirKAGEw0ZQGeKUKpPrRGrUzCPerPF3tn8gl-qjaLLmstEDw_uRldY5qwt8HfMiby-PX_KrHIK02Qvro4taKGro744 Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: e06efd9f018749e3931f713b485d6f84 Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:08:25.852132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e06efd9f018749e3931f713b485d6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e06efd9f018749e3931f713b485d6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e06efd9f018749e3931f713b485d6f84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e06efd9f018749e3931f713b485d6f84"}]}] Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: e06efd9f018749e3931f713b485d6f84 Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-DeleteServersTestJSON-586411950-project Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 0a8cc558dee74179b538f20c1b90f44c Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-DeleteServersTestJSON-586411950-project Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.853551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '13ae5dc0-905f-467a-904f-af2631f8e574'} Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:08:25.854399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.856244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.857472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Returning 404 to user: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:08:25.857472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d6c4e2ab-f5d6-4777-8d84-f322ce3384ef tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 404 len: 111 microversion: 2.1 time: 0.032005 Jun 22 09:08:25.857472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 84/183] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:25 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:08:25.954961 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:25.955891 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:25.961839 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.962282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.963066 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.963502 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.976071 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] HTTP exception thrown: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Request method failure captured: Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574/os-volume_attachments HTTP/1.1 Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvJHBlEkBzkObMWpAs2-MWHYG6QNFXil1TKyLI4a4gOYGmZeSW_37TCslc_uPYNd7rkKcWMzsa_z36_rGXSqCirKAGEw0ZQGeKUKpPrRGrUzCPerPF3tn8gl-qjaLLmstEDw_uRldY5qwt8HfMiby-PX_KrHIK02Qvro4taKGro744 Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: e06efd9f018749e3931f713b485d6f84 Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:08:25.981103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e06efd9f018749e3931f713b485d6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e06efd9f018749e3931f713b485d6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e06efd9f018749e3931f713b485d6f84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e06efd9f018749e3931f713b485d6f84"}]}] Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: e06efd9f018749e3931f713b485d6f84 Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-DeleteServersTestJSON-586411950-project Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0a8cc558dee74179b538f20c1b90f44c Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-DeleteServersTestJSON-586411950-project Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.982228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'server_id': '13ae5dc0-905f-467a-904f-af2631f8e574'} Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:08:25.982919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:25.984929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:25.986200 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Returning 404 to user: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:08:25.986200 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a21bb259-c2a4-4156-8699-c6bc6e835ab4 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031601 Jun 22 09:08:25.986200 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 100/184] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:08:25 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:08:26.472536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ed97e175-12be-4760-93fb-692c71611513 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:26.473142 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ed97e175-12be-4760-93fb-692c71611513 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:26.480297 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ed97e175-12be-4760-93fb-692c71611513 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:26.480948 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ed97e175-12be-4760-93fb-692c71611513 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:26.481945 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ed97e175-12be-4760-93fb-692c71611513 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:26.482379 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ed97e175-12be-4760-93fb-692c71611513 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:26.629808 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ed97e175-12be-4760-93fb-692c71611513 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:26.633593 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:26.638223 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ed97e175-12be-4760-93fb-692c71611513 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.169546 Jun 22 09:08:26.638799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 85/185] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:26 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:26.681382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bbb66cbe-230d-4d21-984b-b19df95912b9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:26.682036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bbb66cbe-230d-4d21-984b-b19df95912b9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:26.688171 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bbb66cbe-230d-4d21-984b-b19df95912b9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:26.688613 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bbb66cbe-230d-4d21-984b-b19df95912b9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:26.689361 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bbb66cbe-230d-4d21-984b-b19df95912b9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:26.693773 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bbb66cbe-230d-4d21-984b-b19df95912b9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:26.849178 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bbb66cbe-230d-4d21-984b-b19df95912b9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:26.856872 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bbb66cbe-230d-4d21-984b-b19df95912b9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.179400 Jun 22 09:08:26.857452 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 101/186] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:26 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:27.655851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5c277323-9f30-4674-bcd1-98d6cb462c75 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:27.656392 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5c277323-9f30-4674-bcd1-98d6cb462c75 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:27.658556 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:27.664145 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5c277323-9f30-4674-bcd1-98d6cb462c75 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:27.667195 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5c277323-9f30-4674-bcd1-98d6cb462c75 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:27.667195 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5c277323-9f30-4674-bcd1-98d6cb462c75 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:27.667195 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5c277323-9f30-4674-bcd1-98d6cb462c75 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:27.801614 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5c277323-9f30-4674-bcd1-98d6cb462c75 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:27.809842 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5c277323-9f30-4674-bcd1-98d6cb462c75 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.158557 Jun 22 09:08:27.810436 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 86/187] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:27 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:27.873442 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9c6d1242-c702-47cc-ada9-5e8bf2a1f74d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:27.874072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9c6d1242-c702-47cc-ada9-5e8bf2a1f74d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:27.876063 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:27.880863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9c6d1242-c702-47cc-ada9-5e8bf2a1f74d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:27.881314 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9c6d1242-c702-47cc-ada9-5e8bf2a1f74d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:27.882074 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9c6d1242-c702-47cc-ada9-5e8bf2a1f74d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:27.882507 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9c6d1242-c702-47cc-ada9-5e8bf2a1f74d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:28.019260 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9c6d1242-c702-47cc-ada9-5e8bf2a1f74d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:28.027006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9c6d1242-c702-47cc-ada9-5e8bf2a1f74d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.157194 Jun 22 09:08:28.027450 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 102/188] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:27 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:28.829614 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e94bbc18-89c5-4387-8f95-4ce9591198a9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:28.829614 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e94bbc18-89c5-4387-8f95-4ce9591198a9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:28.831135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=8 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:28.836574 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e94bbc18-89c5-4387-8f95-4ce9591198a9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:28.837010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e94bbc18-89c5-4387-8f95-4ce9591198a9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:28.837753 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e94bbc18-89c5-4387-8f95-4ce9591198a9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:28.838185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e94bbc18-89c5-4387-8f95-4ce9591198a9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:28.972132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e94bbc18-89c5-4387-8f95-4ce9591198a9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:28.981155 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e94bbc18-89c5-4387-8f95-4ce9591198a9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.157948 Jun 22 09:08:28.981722 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 87/189] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:28 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:29.044082 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f9f99b39-8f39-44a1-b06a-ced016216c1d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:29.044692 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f9f99b39-8f39-44a1-b06a-ced016216c1d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:29.050888 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f9f99b39-8f39-44a1-b06a-ced016216c1d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:29.051335 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f9f99b39-8f39-44a1-b06a-ced016216c1d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:29.054683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f9f99b39-8f39-44a1-b06a-ced016216c1d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:29.054683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f9f99b39-8f39-44a1-b06a-ced016216c1d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:29.193402 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f9f99b39-8f39-44a1-b06a-ced016216c1d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:29.205275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f9f99b39-8f39-44a1-b06a-ced016216c1d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.165565 Jun 22 09:08:29.207413 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 103/190] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:29 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:29.433375 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:29.433859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:29.440391 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:29.440828 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:29.441574 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:29.442000 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:29.458748 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] HTTP exception thrown: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Request method failure captured: Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 HTTP/1.1 Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvJHBlEkBzkObMWpAs2-MWHYG6QNFXil1TKyLI4a4gOYGmZeSW_37TCslc_uPYNd7rkKcWMzsa_z36_rGXSqCirKAGEw0ZQGeKUKpPrRGrUzCPerPF3tn8gl-qjaLLmstEDw_uRldY5qwt8HfMiby-PX_KrHIK02Qvro4taKGro744 Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: e06efd9f018749e3931f713b485d6f84 Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:08:29.460794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e06efd9f018749e3931f713b485d6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e06efd9f018749e3931f713b485d6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e06efd9f018749e3931f713b485d6f84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e06efd9f018749e3931f713b485d6f84"}]}] Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: e06efd9f018749e3931f713b485d6f84 Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-DeleteServersTestJSON-586411950-project Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 0a8cc558dee74179b538f20c1b90f44c Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-DeleteServersTestJSON-586411950-project Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.462213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '13ae5dc0-905f-467a-904f-af2631f8e574'} Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:08:29.465836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.467408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.468751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Returning 404 to user: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:08:29.468751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-341c29b5-4098-42df-a19a-c837369145b0 tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "DELETE /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 404 len: 111 microversion: 2.1 time: 0.033615 Jun 22 09:08:29.468751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 88/191] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:08:29 2022] DELETE /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:08:29.473363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:29.474390 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] [instance: 13ae5dc0-905f-467a-904f-af2631f8e574] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:29.492997 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:29.492997 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:29.492997 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:29.492997 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:29.502162 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] HTTP exception thrown: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Request method failure captured: Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 HTTP/1.1 Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvJHBlEkBzkObMWpAs2-MWHYG6QNFXil1TKyLI4a4gOYGmZeSW_37TCslc_uPYNd7rkKcWMzsa_z36_rGXSqCirKAGEw0ZQGeKUKpPrRGrUzCPerPF3tn8gl-qjaLLmstEDw_uRldY5qwt8HfMiby-PX_KrHIK02Qvro4taKGro744 Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: e06efd9f018749e3931f713b485d6f84 Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:08:29.504565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e06efd9f018749e3931f713b485d6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e06efd9f018749e3931f713b485d6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e06efd9f018749e3931f713b485d6f84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e06efd9f018749e3931f713b485d6f84"}]}] Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: e06efd9f018749e3931f713b485d6f84 Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-DeleteServersTestJSON-586411950 Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-DeleteServersTestJSON-586411950-project Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0a8cc558dee74179b538f20c1b90f44c Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-DeleteServersTestJSON-586411950-project Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.506008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '13ae5dc0-905f-467a-904f-af2631f8e574'} Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:08:29.507004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. Jun 22 09:08:29.508316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:08:29.509552 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] Returning 404 to user: Instance 13ae5dc0-905f-467a-904f-af2631f8e574 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:08:29.509552 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c7db251f-0aad-46c3-a81d-200e78230adc tempest-DeleteServersTestJSON-586411950 tempest-DeleteServersTestJSON-586411950-project] 10.222.0.55 "GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574" status: 404 len: 111 microversion: 2.1 time: 0.039244 Jun 22 09:08:29.511086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 104/192] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:29 2022] GET /compute/v2.1/servers/13ae5dc0-905f-467a-904f-af2631f8e574 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:08:29.999212 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ba1a2954-2445-4bb2-9901-2332017dc658 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:30.000119 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ba1a2954-2445-4bb2-9901-2332017dc658 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:30.007903 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba1a2954-2445-4bb2-9901-2332017dc658 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:30.008348 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba1a2954-2445-4bb2-9901-2332017dc658 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:30.009517 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba1a2954-2445-4bb2-9901-2332017dc658 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:30.010270 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba1a2954-2445-4bb2-9901-2332017dc658 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:30.154694 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ba1a2954-2445-4bb2-9901-2332017dc658 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:30.164879 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ba1a2954-2445-4bb2-9901-2332017dc658 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.171273 Jun 22 09:08:30.165590 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 89/193] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:29 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:30.225688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9f341d86-cba0-467e-9516-9810a21caae4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:30.226342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9f341d86-cba0-467e-9516-9810a21caae4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:30.233631 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9f341d86-cba0-467e-9516-9810a21caae4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:30.234080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9f341d86-cba0-467e-9516-9810a21caae4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:30.234857 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9f341d86-cba0-467e-9516-9810a21caae4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:30.235297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9f341d86-cba0-467e-9516-9810a21caae4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:30.530559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9f341d86-cba0-467e-9516-9810a21caae4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:30.544108 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9f341d86-cba0-467e-9516-9810a21caae4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.322136 Jun 22 09:08:30.545714 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 105/194] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:30 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:31.181387 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-320c29c9-7c66-46c7-97c0-b88d6e661b1e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:31.181913 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-320c29c9-7c66-46c7-97c0-b88d6e661b1e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:31.189974 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-320c29c9-7c66-46c7-97c0-b88d6e661b1e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:31.190432 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-320c29c9-7c66-46c7-97c0-b88d6e661b1e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:31.193625 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-320c29c9-7c66-46c7-97c0-b88d6e661b1e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:31.193625 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-320c29c9-7c66-46c7-97c0-b88d6e661b1e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:31.340765 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-320c29c9-7c66-46c7-97c0-b88d6e661b1e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:31.348326 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-320c29c9-7c66-46c7-97c0-b88d6e661b1e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.170520 Jun 22 09:08:31.348857 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 90/195] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:31 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:31.561697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4030d7ac-7614-41ac-bcaa-effddfbb05e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:31.562341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4030d7ac-7614-41ac-bcaa-effddfbb05e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:31.568833 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4030d7ac-7614-41ac-bcaa-effddfbb05e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:31.569277 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4030d7ac-7614-41ac-bcaa-effddfbb05e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:31.570029 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4030d7ac-7614-41ac-bcaa-effddfbb05e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:31.570499 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4030d7ac-7614-41ac-bcaa-effddfbb05e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:31.575287 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:31.819224 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4030d7ac-7614-41ac-bcaa-effddfbb05e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:31.837740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4030d7ac-7614-41ac-bcaa-effddfbb05e4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.278336 Jun 22 09:08:31.846138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 106/196] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:31 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:32.367220 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b111bf69-9adc-47a2-86f9-583bb83bd931 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:32.367882 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b111bf69-9adc-47a2-86f9-583bb83bd931 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:32.375423 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b111bf69-9adc-47a2-86f9-583bb83bd931 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:32.375877 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b111bf69-9adc-47a2-86f9-583bb83bd931 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:32.376656 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b111bf69-9adc-47a2-86f9-583bb83bd931 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:32.377281 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b111bf69-9adc-47a2-86f9-583bb83bd931 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:32.732600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b111bf69-9adc-47a2-86f9-583bb83bd931 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:32.740390 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b111bf69-9adc-47a2-86f9-583bb83bd931 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.378767 Jun 22 09:08:32.740948 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 91/197] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:32 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:32.862521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b6693bc0-2d96-4879-8749-545b8c8ab61d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:32.863266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b6693bc0-2d96-4879-8749-545b8c8ab61d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:32.870606 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6693bc0-2d96-4879-8749-545b8c8ab61d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:32.871130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6693bc0-2d96-4879-8749-545b8c8ab61d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:32.871894 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6693bc0-2d96-4879-8749-545b8c8ab61d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:32.872360 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6693bc0-2d96-4879-8749-545b8c8ab61d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:32.999797 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b6693bc0-2d96-4879-8749-545b8c8ab61d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:33.007182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b6693bc0-2d96-4879-8749-545b8c8ab61d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.148963 Jun 22 09:08:33.008324 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 107/198] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:32 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:33.757826 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d133db81-3de7-4aac-90a7-7bb8e3fd4b45 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:33.758730 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d133db81-3de7-4aac-90a7-7bb8e3fd4b45 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:33.768919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d133db81-3de7-4aac-90a7-7bb8e3fd4b45 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:33.769360 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d133db81-3de7-4aac-90a7-7bb8e3fd4b45 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:33.770120 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d133db81-3de7-4aac-90a7-7bb8e3fd4b45 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:33.770597 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d133db81-3de7-4aac-90a7-7bb8e3fd4b45 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:33.931658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d133db81-3de7-4aac-90a7-7bb8e3fd4b45 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:33.943019 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d133db81-3de7-4aac-90a7-7bb8e3fd4b45 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.186574 Jun 22 09:08:33.943019 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 92/199] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:33 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:34.028401 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c516838a-f9ac-4eb3-bd11-ebc4a423f49e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:34.028401 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c516838a-f9ac-4eb3-bd11-ebc4a423f49e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:34.035995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c516838a-f9ac-4eb3-bd11-ebc4a423f49e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:34.036438 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c516838a-f9ac-4eb3-bd11-ebc4a423f49e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:34.037203 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c516838a-f9ac-4eb3-bd11-ebc4a423f49e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:34.037779 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c516838a-f9ac-4eb3-bd11-ebc4a423f49e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:34.056788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-019183d5-5a3d-4c7f-921c-df452c0c290f req-4c50c4b3-360b-4a8e-b5fd-8251957d7b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e81493b-721d-4eff-a43f-85d2b26c3e25", "name": "network-vif-plugged", "status": "completed", "tag": "4aca7fad-7c3e-433c-a3a4-675450c7a2d2"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:34.076948 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-019183d5-5a3d-4c7f-921c-df452c0c290f req-4c50c4b3-360b-4a8e-b5fd-8251957d7b07 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:34.077387 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-019183d5-5a3d-4c7f-921c-df452c0c290f req-4c50c4b3-360b-4a8e-b5fd-8251957d7b07 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:34.091357 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-019183d5-5a3d-4c7f-921c-df452c0c290f req-4c50c4b3-360b-4a8e-b5fd-8251957d7b07 service nova] Creating event network-vif-plugged:4aca7fad-7c3e-433c-a3a4-675450c7a2d2 for instance 0e81493b-721d-4eff-a43f-85d2b26c3e25 on hv-cinder-80382 Jun 22 09:08:34.105034 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-019183d5-5a3d-4c7f-921c-df452c0c290f req-4c50c4b3-360b-4a8e-b5fd-8251957d7b07 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053342 Jun 22 09:08:34.106220 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 93/200] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:34.457890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c516838a-f9ac-4eb3-bd11-ebc4a423f49e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:34.467274 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c516838a-f9ac-4eb3-bd11-ebc4a423f49e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.446065 Jun 22 09:08:34.467854 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 108/201] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:34 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:34.957962 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c3029f97-d7b8-4d07-bec2-1865303b7056 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:34.958646 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c3029f97-d7b8-4d07-bec2-1865303b7056 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:34.965532 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c3029f97-d7b8-4d07-bec2-1865303b7056 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:34.970958 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c3029f97-d7b8-4d07-bec2-1865303b7056 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:34.970958 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c3029f97-d7b8-4d07-bec2-1865303b7056 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:34.970958 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c3029f97-d7b8-4d07-bec2-1865303b7056 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:35.113789 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c3029f97-d7b8-4d07-bec2-1865303b7056 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:35.121446 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c3029f97-d7b8-4d07-bec2-1865303b7056 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.168004 Jun 22 09:08:35.122018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 94/202] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:34 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:35.483265 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ddc8e249-9666-4762-8b82-298cab19e4be tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:35.483875 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ddc8e249-9666-4762-8b82-298cab19e4be tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:35.489970 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ddc8e249-9666-4762-8b82-298cab19e4be tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:35.490416 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ddc8e249-9666-4762-8b82-298cab19e4be tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:35.491245 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ddc8e249-9666-4762-8b82-298cab19e4be tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:35.491678 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ddc8e249-9666-4762-8b82-298cab19e4be tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:35.621311 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ddc8e249-9666-4762-8b82-298cab19e4be tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:35.628734 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ddc8e249-9666-4762-8b82-298cab19e4be tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.149313 Jun 22 09:08:35.629300 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 109/203] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:35 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:36.137609 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-995cafb3-1cd4-4891-b2b2-98b6759d5c69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:36.138530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-995cafb3-1cd4-4891-b2b2-98b6759d5c69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:36.144613 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-995cafb3-1cd4-4891-b2b2-98b6759d5c69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:36.144966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-995cafb3-1cd4-4891-b2b2-98b6759d5c69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:36.145726 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-995cafb3-1cd4-4891-b2b2-98b6759d5c69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:36.146433 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-995cafb3-1cd4-4891-b2b2-98b6759d5c69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:36.281996 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-995cafb3-1cd4-4891-b2b2-98b6759d5c69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:36.289466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-995cafb3-1cd4-4891-b2b2-98b6759d5c69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.155919 Jun 22 09:08:36.290040 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 95/204] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:36 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:36.646338 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-66cdfcba-b6b6-480e-9911-d2f78cdcfc00 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:36.646964 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-66cdfcba-b6b6-480e-9911-d2f78cdcfc00 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:36.654254 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-66cdfcba-b6b6-480e-9911-d2f78cdcfc00 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:36.654698 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-66cdfcba-b6b6-480e-9911-d2f78cdcfc00 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:36.655487 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-66cdfcba-b6b6-480e-9911-d2f78cdcfc00 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:36.655919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-66cdfcba-b6b6-480e-9911-d2f78cdcfc00 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:36.853724 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-66cdfcba-b6b6-480e-9911-d2f78cdcfc00 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:36.865662 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-66cdfcba-b6b6-480e-9911-d2f78cdcfc00 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.222657 Jun 22 09:08:36.867105 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 110/205] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:36 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:37.306549 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d2a8dcdf-8480-4db4-a623-523986870ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:37.307192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d2a8dcdf-8480-4db4-a623-523986870ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:37.314047 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d2a8dcdf-8480-4db4-a623-523986870ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:37.314529 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d2a8dcdf-8480-4db4-a623-523986870ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:37.315331 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d2a8dcdf-8480-4db4-a623-523986870ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:37.315752 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d2a8dcdf-8480-4db4-a623-523986870ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:37.450127 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d2a8dcdf-8480-4db4-a623-523986870ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:37.457501 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d2a8dcdf-8480-4db4-a623-523986870ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.154729 Jun 22 09:08:37.458130 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 96/206] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:37 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:37.883952 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7f1f1527-67a3-48a9-9f0b-9cdbcdc91d43 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:37.884568 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7f1f1527-67a3-48a9-9f0b-9cdbcdc91d43 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:37.890557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7f1f1527-67a3-48a9-9f0b-9cdbcdc91d43 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:37.894983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7f1f1527-67a3-48a9-9f0b-9cdbcdc91d43 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:37.894983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7f1f1527-67a3-48a9-9f0b-9cdbcdc91d43 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:37.894983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7f1f1527-67a3-48a9-9f0b-9cdbcdc91d43 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:38.046358 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7f1f1527-67a3-48a9-9f0b-9cdbcdc91d43 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:38.054235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7f1f1527-67a3-48a9-9f0b-9cdbcdc91d43 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.174749 Jun 22 09:08:38.055054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 111/207] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:37 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:08:38.474733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c227f69f-9205-4720-8c43-011e678bfcfb tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:38.475931 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c227f69f-9205-4720-8c43-011e678bfcfb tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:38.485396 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c227f69f-9205-4720-8c43-011e678bfcfb tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:38.485850 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c227f69f-9205-4720-8c43-011e678bfcfb tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:38.486754 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c227f69f-9205-4720-8c43-011e678bfcfb tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:38.487403 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c227f69f-9205-4720-8c43-011e678bfcfb tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:38.694376 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c227f69f-9205-4720-8c43-011e678bfcfb tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:38.702604 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c227f69f-9205-4720-8c43-011e678bfcfb tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.232090 Jun 22 09:08:38.703390 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 97/208] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:38 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:39.071258 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6de96d16-764f-46d2-8231-0ad8134a0299 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:39.072239 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6de96d16-764f-46d2-8231-0ad8134a0299 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:39.078411 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6de96d16-764f-46d2-8231-0ad8134a0299 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:39.080531 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6de96d16-764f-46d2-8231-0ad8134a0299 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:39.080531 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6de96d16-764f-46d2-8231-0ad8134a0299 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:39.080531 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6de96d16-764f-46d2-8231-0ad8134a0299 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:39.233134 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6de96d16-764f-46d2-8231-0ad8134a0299 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:39.242042 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6de96d16-764f-46d2-8231-0ad8134a0299 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1318 microversion: 2.1 time: 0.174596 Jun 22 09:08:39.242784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 112/209] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:39 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:39.719930 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-25d95565-a551-4b98-8e11-7ebc6c9c7570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:39.720552 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-25d95565-a551-4b98-8e11-7ebc6c9c7570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:39.723057 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:39.728364 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25d95565-a551-4b98-8e11-7ebc6c9c7570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:39.728810 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25d95565-a551-4b98-8e11-7ebc6c9c7570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:39.729592 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25d95565-a551-4b98-8e11-7ebc6c9c7570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:39.730060 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25d95565-a551-4b98-8e11-7ebc6c9c7570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:39.876218 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-25d95565-a551-4b98-8e11-7ebc6c9c7570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:39.888651 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-25d95565-a551-4b98-8e11-7ebc6c9c7570 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.172627 Jun 22 09:08:39.889346 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 98/210] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:39 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:40.260690 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d029fdd0-bf65-41ca-8c54-ed5b34f2a1d0 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:40.261859 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d029fdd0-bf65-41ca-8c54-ed5b34f2a1d0 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:40.271583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d029fdd0-bf65-41ca-8c54-ed5b34f2a1d0 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:40.272379 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d029fdd0-bf65-41ca-8c54-ed5b34f2a1d0 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:40.274488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d029fdd0-bf65-41ca-8c54-ed5b34f2a1d0 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:40.275155 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d029fdd0-bf65-41ca-8c54-ed5b34f2a1d0 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:40.511869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d029fdd0-bf65-41ca-8c54-ed5b34f2a1d0 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:40.521151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d029fdd0-bf65-41ca-8c54-ed5b34f2a1d0 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1508 microversion: 2.1 time: 0.264034 Jun 22 09:08:40.521853 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 113/211] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:40 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:40.906099 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-40877ada-0486-4a74-a70a-1a79816dd470 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:40.907326 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-40877ada-0486-4a74-a70a-1a79816dd470 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:40.914892 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-40877ada-0486-4a74-a70a-1a79816dd470 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:40.915342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-40877ada-0486-4a74-a70a-1a79816dd470 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:40.916104 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-40877ada-0486-4a74-a70a-1a79816dd470 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:40.916885 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-40877ada-0486-4a74-a70a-1a79816dd470 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:41.140273 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-40877ada-0486-4a74-a70a-1a79816dd470 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:41.151582 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-40877ada-0486-4a74-a70a-1a79816dd470 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.249196 Jun 22 09:08:41.155604 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 99/212] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:40 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:42.177421 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-211d7238-ff2d-4d39-a90c-66aaf742ec55 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:42.177421 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-211d7238-ff2d-4d39-a90c-66aaf742ec55 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:42.178206 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6730dba4-0618-4e37-b18d-4a94c2134c21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'create', calling method: .version_select at 0x7f500e610f70>, body: {"keypair": {"name": "tempest-keypair-376511490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMGa+NBAc6Sji7qMFFZBM0OrBCCrdCZN6w2GY5KgoG5dfRL/Kem6mpDss6RtmZzeuLj9MC7laeOGMhilAkIG8nJ75dCJc7o8U9kR7O4ghky1o2zBrlO52wCTYHX7GO/mg=="}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:42.182353 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-211d7238-ff2d-4d39-a90c-66aaf742ec55 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:42.183376 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-211d7238-ff2d-4d39-a90c-66aaf742ec55 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:42.184378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-211d7238-ff2d-4d39-a90c-66aaf742ec55 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:42.185016 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-211d7238-ff2d-4d39-a90c-66aaf742ec55 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:42.204167 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-6730dba4-0618-4e37-b18d-4a94c2134c21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Getting quotas for project 27cd77392b924e64ba52350c775cf638. Resources: {'key_pairs'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:08:42.210653 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-6730dba4-0618-4e37-b18d-4a94c2134c21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Getting quotas for user 8e3e567058964720964d98e76e55e462 and project 27cd77392b924e64ba52350c775cf638. Resources: {'key_pairs'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:08:42.296017 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6730dba4-0618-4e37-b18d-4a94c2134c21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.247820 Jun 22 09:08:42.300486 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 114/213] 10.222.0.55 () {62 vars in 1199 bytes} [Wed Jun 22 09:08:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 09:08:42.383892 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-211d7238-ff2d-4d39-a90c-66aaf742ec55 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:42.393064 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-211d7238-ff2d-4d39-a90c-66aaf742ec55 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1522 microversion: 2.1 time: 0.226609 Jun 22 09:08:42.395272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 100/214] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:42 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:43.411185 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-632ee028-fff6-4562-8bed-8b6f4099329e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:43.411796 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-632ee028-fff6-4562-8bed-8b6f4099329e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:43.418349 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-632ee028-fff6-4562-8bed-8b6f4099329e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:43.419250 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-632ee028-fff6-4562-8bed-8b6f4099329e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:43.419577 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-632ee028-fff6-4562-8bed-8b6f4099329e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:43.420021 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-632ee028-fff6-4562-8bed-8b6f4099329e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:43.592743 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-632ee028-fff6-4562-8bed-8b6f4099329e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:43.601154 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-632ee028-fff6-4562-8bed-8b6f4099329e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1502 microversion: 2.1 time: 0.194070 Jun 22 09:08:43.602088 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 115/215] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:43 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:43.617227 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-242e3753-6680-4ff0-9013-5a89d8548d19 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:43.617892 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-242e3753-6680-4ff0-9013-5a89d8548d19 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:43.625023 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-242e3753-6680-4ff0-9013-5a89d8548d19 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:43.625477 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-242e3753-6680-4ff0-9013-5a89d8548d19 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:43.626243 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-242e3753-6680-4ff0-9013-5a89d8548d19 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:43.626680 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-242e3753-6680-4ff0-9013-5a89d8548d19 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:43.877929 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-242e3753-6680-4ff0-9013-5a89d8548d19 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:43.895178 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-242e3753-6680-4ff0-9013-5a89d8548d19 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1515 microversion: 2.1 time: 0.274442 Jun 22 09:08:43.895178 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 101/216] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:43 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:45.082779 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1988299031", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dc0d09c-c23d-458d-8834-ba6f7c377f1b"}], "security_groups": [{"name": "tempest-securitygroup--401865863"}], "key_name": "tempest-keypair-376511490", "user_data": "}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:45.223485 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] validate_networks() for [('4dc0d09c-c23d-458d-8834-ba6f7c377f1b', None, None, None, None, None)] {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:08:45.786028 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c6ccdc25-f11d-457a-9c7d-443d0a523f04 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:45.796493 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c6ccdc25-f11d-457a-9c7d-443d0a523f04 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:45.815488 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c6ccdc25-f11d-457a-9c7d-443d0a523f04 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:45.815956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c6ccdc25-f11d-457a-9c7d-443d0a523f04 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:45.819805 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c6ccdc25-f11d-457a-9c7d-443d0a523f04 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:45.821432 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c6ccdc25-f11d-457a-9c7d-443d0a523f04 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:45.890545 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-c6ccdc25-f11d-457a-9c7d-443d0a523f04 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lazy-loading 'flavor' on Instance uuid cf015553-3a8f-459a-a15a-f269b6d3dae6 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:08:45.922176 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:08:45.922653 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:08:45.923257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:08:45.923626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:08:45.924291 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:08:45.941884 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:45.942334 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:45.943195 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:45.943621 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:45.971334 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Getting quotas for project 27cd77392b924e64ba52350c775cf638. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:08:45.976837 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Getting quotas for user 8e3e567058964720964d98e76e55e462 and project 27cd77392b924e64ba52350c775cf638. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:08:45.992398 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:08:45.997355 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:08:45.999050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:46.144688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b4a49c30-a9d3-4ec3-84d5-bdc4974cf430 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.067391 Jun 22 09:08:46.145491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 116/217] 10.222.0.55 () {62 vars in 1187 bytes} [Wed Jun 22 09:08:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 09:08:46.155787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5046a436-4686-48e9-bbab-1b19af3c1606 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:46.156478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5046a436-4686-48e9-bbab-1b19af3c1606 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:46.235317 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c6ccdc25-f11d-457a-9c7d-443d0a523f04 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6/action" status: 200 len: 32 microversion: 2.1 time: 0.459804 Jun 22 09:08:46.236573 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 102/218] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:08:45 2022] POST /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6/action => generated 32 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 09:08:46.262248 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ad19a435-d320-414f-883c-7c9354775471 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:46.263178 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ad19a435-d320-414f-883c-7c9354775471 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:46.273092 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ad19a435-d320-414f-883c-7c9354775471 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:46.274598 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ad19a435-d320-414f-883c-7c9354775471 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:46.277913 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ad19a435-d320-414f-883c-7c9354775471 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:46.283213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ad19a435-d320-414f-883c-7c9354775471 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:46.308320 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5046a436-4686-48e9-bbab-1b19af3c1606 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:46.317509 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5046a436-4686-48e9-bbab-1b19af3c1606 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:46.323232 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5046a436-4686-48e9-bbab-1b19af3c1606 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:46.323232 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5046a436-4686-48e9-bbab-1b19af3c1606 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1281 microversion: 2.20 time: 0.168441 Jun 22 09:08:46.323232 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 117/219] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:46 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:08:46.568637 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ad19a435-d320-414f-883c-7c9354775471 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:46.587867 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ad19a435-d320-414f-883c-7c9354775471 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.329854 Jun 22 09:08:46.587867 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 103/220] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:46 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:47.337869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8c30f5a8-e1e3-44ec-be60-8a274ca94033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:47.338474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8c30f5a8-e1e3-44ec-be60-8a274ca94033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:47.340975 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:47.413318 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8c30f5a8-e1e3-44ec-be60-8a274ca94033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:47.421057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8c30f5a8-e1e3-44ec-be60-8a274ca94033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:47.426734 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8c30f5a8-e1e3-44ec-be60-8a274ca94033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:47.428247 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8c30f5a8-e1e3-44ec-be60-8a274ca94033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1281 microversion: 2.20 time: 0.094250 Jun 22 09:08:47.431902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 118/221] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:47 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:47.601129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8d197501-3e47-4b4b-b35f-b9a72c32c24f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:47.601911 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8d197501-3e47-4b4b-b35f-b9a72c32c24f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:47.608714 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d197501-3e47-4b4b-b35f-b9a72c32c24f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:47.609159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d197501-3e47-4b4b-b35f-b9a72c32c24f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:47.609914 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d197501-3e47-4b4b-b35f-b9a72c32c24f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:47.610345 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d197501-3e47-4b4b-b35f-b9a72c32c24f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:47.772912 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8d197501-3e47-4b4b-b35f-b9a72c32c24f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:47.781404 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8d197501-3e47-4b4b-b35f-b9a72c32c24f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.183529 Jun 22 09:08:47.782371 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 104/222] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:47 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:48.454445 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:48.455073 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:48.471690 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:48.472146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:48.472900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:48.473329 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:48.541505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:48.552798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:48.554353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:48.555535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-17c40a03-0195-40fe-b700-1d6545dfe2d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1333 microversion: 2.20 time: 0.110380 Jun 22 09:08:48.556092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 119/223] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:48 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1333 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:48.797772 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3c3b09a3-b18b-4ffc-91a9-0b644fccc5d4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:48.798466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3c3b09a3-b18b-4ffc-91a9-0b644fccc5d4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:48.805823 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c3b09a3-b18b-4ffc-91a9-0b644fccc5d4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:48.806277 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c3b09a3-b18b-4ffc-91a9-0b644fccc5d4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:48.807069 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c3b09a3-b18b-4ffc-91a9-0b644fccc5d4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:48.807507 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c3b09a3-b18b-4ffc-91a9-0b644fccc5d4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:48.961967 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3c3b09a3-b18b-4ffc-91a9-0b644fccc5d4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:48.974054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3c3b09a3-b18b-4ffc-91a9-0b644fccc5d4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.178400 Jun 22 09:08:48.974054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 105/224] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:48 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:49.576846 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:49.577455 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:49.584352 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:49.584795 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:49.585566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:49.585998 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:49.660042 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:49.670198 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:49.671736 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:49.672870 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fbeb94b9-de57-494e-9a95-f9b227b0732d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1339 microversion: 2.20 time: 0.101652 Jun 22 09:08:49.673425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 120/225] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:49 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:49.996226 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2858c3ef-1910-4777-85ee-5e19fef045da tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:49.996948 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2858c3ef-1910-4777-85ee-5e19fef045da tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:50.004696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2858c3ef-1910-4777-85ee-5e19fef045da tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:50.005813 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2858c3ef-1910-4777-85ee-5e19fef045da tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:50.006947 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2858c3ef-1910-4777-85ee-5e19fef045da tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:50.007683 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2858c3ef-1910-4777-85ee-5e19fef045da tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:50.225662 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2858c3ef-1910-4777-85ee-5e19fef045da tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:50.235188 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2858c3ef-1910-4777-85ee-5e19fef045da tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.248517 Jun 22 09:08:50.235765 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 106/226] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:49 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:50.690527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:50.691278 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:50.702419 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:50.703170 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:50.704205 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:50.705043 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:50.872978 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:50.880329 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:50.881990 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:50.883677 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e2d00673-7fa6-41e6-8d3a-57543c7261b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1406 microversion: 2.20 time: 0.196803 Jun 22 09:08:50.885546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 121/227] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:50 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:50.951515 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-679f2a1b-932c-45da-a0e6-d2c8fe52d385 req-ff472ecf-0199-4a41-8539-fdb21bb38747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c02245-d347-4fe2-8836-ca64aeb90e74", "tag": "5897603a-c758-4aef-b13d-a1bcac6199a0"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:50.960025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-679f2a1b-932c-45da-a0e6-d2c8fe52d385 req-ff472ecf-0199-4a41-8539-fdb21bb38747 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:50.960466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-679f2a1b-932c-45da-a0e6-d2c8fe52d385 req-ff472ecf-0199-4a41-8539-fdb21bb38747 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:50.973273 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-679f2a1b-932c-45da-a0e6-d2c8fe52d385 req-ff472ecf-0199-4a41-8539-fdb21bb38747 service nova] Creating event network-changed:5897603a-c758-4aef-b13d-a1bcac6199a0 for instance 04c02245-d347-4fe2-8836-ca64aeb90e74 on hv-cinder-80382 Jun 22 09:08:50.978793 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-679f2a1b-932c-45da-a0e6-d2c8fe52d385 req-ff472ecf-0199-4a41-8539-fdb21bb38747 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030955 Jun 22 09:08:50.980761 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 107/228] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:08:51.251913 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-09f50316-cb45-4d2f-bd42-88512ea2cfed tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:51.252627 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-09f50316-cb45-4d2f-bd42-88512ea2cfed tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:51.258616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-09f50316-cb45-4d2f-bd42-88512ea2cfed tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:51.259101 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-09f50316-cb45-4d2f-bd42-88512ea2cfed tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:51.259884 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-09f50316-cb45-4d2f-bd42-88512ea2cfed tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:51.260317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-09f50316-cb45-4d2f-bd42-88512ea2cfed tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:51.406167 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-09f50316-cb45-4d2f-bd42-88512ea2cfed tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:51.413718 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-09f50316-cb45-4d2f-bd42-88512ea2cfed tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.165631 Jun 22 09:08:51.414394 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 122/229] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:51 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:51.902627 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:51.903808 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:51.911523 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:51.912501 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:51.912720 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:51.913194 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:52.044987 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:52.052815 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:52.054323 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:52.055445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f30435a8-0800-473c-8da9-1577d0346dcf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1406 microversion: 2.20 time: 0.157899 Jun 22 09:08:52.056016 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 108/230] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:51 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:52.434882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-dfe690df-320b-42ee-8810-81c3b39f5dd4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:52.435488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-dfe690df-320b-42ee-8810-81c3b39f5dd4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:52.442090 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dfe690df-320b-42ee-8810-81c3b39f5dd4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:52.442541 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dfe690df-320b-42ee-8810-81c3b39f5dd4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:52.443403 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dfe690df-320b-42ee-8810-81c3b39f5dd4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:52.443832 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dfe690df-320b-42ee-8810-81c3b39f5dd4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:52.796208 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-dfe690df-320b-42ee-8810-81c3b39f5dd4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:52.803878 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-dfe690df-320b-42ee-8810-81c3b39f5dd4 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.374834 Jun 22 09:08:52.804487 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 123/231] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:52 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:53.075534 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:53.076922 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:53.083758 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:53.084295 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:53.085200 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:53.085695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:53.379533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:53.388137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:53.389656 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:53.392428 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-505eacbf-30e2-4a59-bd8b-77ccd2a8e9cd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1406 microversion: 2.20 time: 0.320312 Jun 22 09:08:53.392428 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 109/232] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:53 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:08:53.820883 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e5fcc92f-7624-4bb0-bdd7-83fc84a9a7f7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:53.821481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e5fcc92f-7624-4bb0-bdd7-83fc84a9a7f7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:53.828288 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e5fcc92f-7624-4bb0-bdd7-83fc84a9a7f7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:53.828824 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e5fcc92f-7624-4bb0-bdd7-83fc84a9a7f7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:53.829669 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e5fcc92f-7624-4bb0-bdd7-83fc84a9a7f7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:53.830323 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e5fcc92f-7624-4bb0-bdd7-83fc84a9a7f7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:53.970209 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e5fcc92f-7624-4bb0-bdd7-83fc84a9a7f7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:53.979471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e5fcc92f-7624-4bb0-bdd7-83fc84a9a7f7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.162228 Jun 22 09:08:53.980343 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 124/233] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:53 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:54.408614 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:54.409330 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:54.415823 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:54.416272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:54.417027 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:54.417464 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:54.550429 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:54.558295 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:54.561012 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:54.561122 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d479b9b9-d037-4613-aa9c-1585fcd2bdb6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1406 microversion: 2.20 time: 0.156321 Jun 22 09:08:54.561650 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 110/234] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:54 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:54.996787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5a4dc42e-9ddd-4310-866a-c5da72f0c6d8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:54.998095 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5a4dc42e-9ddd-4310-866a-c5da72f0c6d8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:55.004673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5a4dc42e-9ddd-4310-866a-c5da72f0c6d8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:55.006093 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5a4dc42e-9ddd-4310-866a-c5da72f0c6d8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:55.007339 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5a4dc42e-9ddd-4310-866a-c5da72f0c6d8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:55.007864 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5a4dc42e-9ddd-4310-866a-c5da72f0c6d8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:55.149939 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5a4dc42e-9ddd-4310-866a-c5da72f0c6d8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:55.157561 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5a4dc42e-9ddd-4310-866a-c5da72f0c6d8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.165429 Jun 22 09:08:55.158141 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 125/235] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:54 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:55.413160 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-ae315c15-82d3-4be9-b1e0-03696f80c746 req-a061577e-8127-406d-bb28-ae42c08cbc5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c02245-d347-4fe2-8836-ca64aeb90e74", "name": "network-vif-plugged", "status": "completed", "tag": "5897603a-c758-4aef-b13d-a1bcac6199a0"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:55.422173 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-ae315c15-82d3-4be9-b1e0-03696f80c746 req-a061577e-8127-406d-bb28-ae42c08cbc5e service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:55.422603 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-ae315c15-82d3-4be9-b1e0-03696f80c746 req-a061577e-8127-406d-bb28-ae42c08cbc5e service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:55.433134 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-ae315c15-82d3-4be9-b1e0-03696f80c746 req-a061577e-8127-406d-bb28-ae42c08cbc5e service nova] Creating event network-vif-plugged:5897603a-c758-4aef-b13d-a1bcac6199a0 for instance 04c02245-d347-4fe2-8836-ca64aeb90e74 on hv-cinder-80382 Jun 22 09:08:55.438456 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-ae315c15-82d3-4be9-b1e0-03696f80c746 req-a061577e-8127-406d-bb28-ae42c08cbc5e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029247 Jun 22 09:08:55.439070 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 111/236] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:55.580003 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:55.580608 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:55.586930 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:55.587462 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:55.588134 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:55.588562 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:55.607477 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:55.726657 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:55.735400 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:55.736932 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:55.738043 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-03346a4d-d226-47f1-a940-34cbd5d9ce37 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1406 microversion: 2.20 time: 0.162095 Jun 22 09:08:55.738598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 126/237] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:55 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:56.175720 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1dcf1c7d-c273-4793-966a-2d7a4ffc9929 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:56.176580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1dcf1c7d-c273-4793-966a-2d7a4ffc9929 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:56.182887 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1dcf1c7d-c273-4793-966a-2d7a4ffc9929 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:56.183337 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1dcf1c7d-c273-4793-966a-2d7a4ffc9929 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:56.184100 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1dcf1c7d-c273-4793-966a-2d7a4ffc9929 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:56.184668 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1dcf1c7d-c273-4793-966a-2d7a4ffc9929 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:56.315895 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1dcf1c7d-c273-4793-966a-2d7a4ffc9929 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:56.323362 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1dcf1c7d-c273-4793-966a-2d7a4ffc9929 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.152730 Jun 22 09:08:56.323917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 112/238] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:56 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:56.755916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:56.756517 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:56.758329 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:56.763344 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:56.763777 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:56.764521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:56.764942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:56.900811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:56.909424 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:56.911005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:56.918308 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e5c1b4e8-03b9-45f5-b453-61009caa0073 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1406 microversion: 2.20 time: 0.160423 Jun 22 09:08:56.918308 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 127/239] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:56 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:57.341084 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-15de19e8-82a5-4f81-9dd9-7a70e5065693 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:57.341717 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-15de19e8-82a5-4f81-9dd9-7a70e5065693 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:57.348209 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-15de19e8-82a5-4f81-9dd9-7a70e5065693 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:57.348654 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-15de19e8-82a5-4f81-9dd9-7a70e5065693 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:57.349411 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-15de19e8-82a5-4f81-9dd9-7a70e5065693 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:57.349845 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-15de19e8-82a5-4f81-9dd9-7a70e5065693 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:57.428071 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d047bec6-c0a2-49d5-96ea-7ef2c658e8fb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:57.428851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d047bec6-c0a2-49d5-96ea-7ef2c658e8fb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:57.434105 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=14 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:57.435847 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d047bec6-c0a2-49d5-96ea-7ef2c658e8fb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:57.436347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d047bec6-c0a2-49d5-96ea-7ef2c658e8fb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:57.437124 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d047bec6-c0a2-49d5-96ea-7ef2c658e8fb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:57.437651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d047bec6-c0a2-49d5-96ea-7ef2c658e8fb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:57.463946 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d047bec6-c0a2-49d5-96ea-7ef2c658e8fb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/ips" status: 200 len: 146 microversion: 2.1 time: 0.039628 Jun 22 09:08:57.465336 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 128/240] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:08:57 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:08:57.485003 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-15de19e8-82a5-4f81-9dd9-7a70e5065693 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:57.492479 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-15de19e8-82a5-4f81-9dd9-7a70e5065693 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.155824 Jun 22 09:08:57.493040 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 113/241] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:57 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:57.929819 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:57.930508 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:57.938638 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:57.941316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:57.941316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:57.941316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:58.070927 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:58.079448 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:58.080953 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:58.082151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1df49ec2-7d04-4015-9696-7a4530d17f13 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1598 microversion: 2.20 time: 0.156360 Jun 22 09:08:58.082642 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 129/242] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:57 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:58.099309 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c5a3dae0-81bb-4a69-ae39-b523aca1e205 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:58.099803 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c5a3dae0-81bb-4a69-ae39-b523aca1e205 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:58.106132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5a3dae0-81bb-4a69-ae39-b523aca1e205 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:58.106573 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5a3dae0-81bb-4a69-ae39-b523aca1e205 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:58.107369 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5a3dae0-81bb-4a69-ae39-b523aca1e205 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:58.107799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5a3dae0-81bb-4a69-ae39-b523aca1e205 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:58.185811 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c5a3dae0-81bb-4a69-ae39-b523aca1e205 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090437 Jun 22 09:08:58.186411 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 114/243] 10.222.0.55 () {60 vars in 1315 bytes} [Wed Jun 22 09:08:58 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:08:58.510689 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a041caf6-fcbc-4b14-a26f-30cf57153ee3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:58.512006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a041caf6-fcbc-4b14-a26f-30cf57153ee3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:58.518236 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a041caf6-fcbc-4b14-a26f-30cf57153ee3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:58.518906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a041caf6-fcbc-4b14-a26f-30cf57153ee3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:58.519798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a041caf6-fcbc-4b14-a26f-30cf57153ee3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:58.520240 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a041caf6-fcbc-4b14-a26f-30cf57153ee3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:58.657516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a041caf6-fcbc-4b14-a26f-30cf57153ee3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:58.667900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a041caf6-fcbc-4b14-a26f-30cf57153ee3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.161864 Jun 22 09:08:58.668926 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 130/244] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:58 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:59.194776 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-be8157f4-8b5b-4eb3-b58d-3b17ba2096f2 req-42bbfe12-25e1-4464-82f3-9688d0b74f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c02245-d347-4fe2-8836-ca64aeb90e74", "tag": "5897603a-c758-4aef-b13d-a1bcac6199a0"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:59.208799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-be8157f4-8b5b-4eb3-b58d-3b17ba2096f2 req-42bbfe12-25e1-4464-82f3-9688d0b74f18 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:59.208799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-be8157f4-8b5b-4eb3-b58d-3b17ba2096f2 req-42bbfe12-25e1-4464-82f3-9688d0b74f18 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:59.215232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-be8157f4-8b5b-4eb3-b58d-3b17ba2096f2 req-42bbfe12-25e1-4464-82f3-9688d0b74f18 service nova] Creating event network-changed:5897603a-c758-4aef-b13d-a1bcac6199a0 for instance 04c02245-d347-4fe2-8836-ca64aeb90e74 on hv-cinder-80382 Jun 22 09:08:59.220135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-be8157f4-8b5b-4eb3-b58d-3b17ba2096f2 req-42bbfe12-25e1-4464-82f3-9688d0b74f18 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029765 Jun 22 09:08:59.221098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 115/245] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:59.686692 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cf37f6a2-c0ab-4885-a601-6897c26d5f66 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:59.692941 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cf37f6a2-c0ab-4885-a601-6897c26d5f66 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:59.694359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf37f6a2-c0ab-4885-a601-6897c26d5f66 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:59.694925 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf37f6a2-c0ab-4885-a601-6897c26d5f66 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:59.695787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf37f6a2-c0ab-4885-a601-6897c26d5f66 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:59.696559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf37f6a2-c0ab-4885-a601-6897c26d5f66 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:59.857037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cf37f6a2-c0ab-4885-a601-6897c26d5f66 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:59.865095 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cf37f6a2-c0ab-4885-a601-6897c26d5f66 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.182386 Jun 22 09:08:59.865744 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 131/246] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:59 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:00.882810 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9066566a-1b2e-48cd-9b2a-0e0bb3cb5202 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:00.883579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9066566a-1b2e-48cd-9b2a-0e0bb3cb5202 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:00.889810 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9066566a-1b2e-48cd-9b2a-0e0bb3cb5202 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:00.890397 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9066566a-1b2e-48cd-9b2a-0e0bb3cb5202 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:00.891195 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9066566a-1b2e-48cd-9b2a-0e0bb3cb5202 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:00.891627 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9066566a-1b2e-48cd-9b2a-0e0bb3cb5202 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:01.027597 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9066566a-1b2e-48cd-9b2a-0e0bb3cb5202 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:01.035278 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9066566a-1b2e-48cd-9b2a-0e0bb3cb5202 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.157535 Jun 22 09:09:01.035850 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 116/247] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:00 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:02.053053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f2256bdd-0804-4726-8c98-a5f58858bebd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:02.053664 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f2256bdd-0804-4726-8c98-a5f58858bebd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:02.060363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2256bdd-0804-4726-8c98-a5f58858bebd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:02.060813 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2256bdd-0804-4726-8c98-a5f58858bebd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:02.061578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2256bdd-0804-4726-8c98-a5f58858bebd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:02.062008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2256bdd-0804-4726-8c98-a5f58858bebd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:02.209824 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f2256bdd-0804-4726-8c98-a5f58858bebd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:02.219644 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f2256bdd-0804-4726-8c98-a5f58858bebd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.170380 Jun 22 09:09:02.220276 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 132/248] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:02 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:03.238047 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8d421ad7-9183-4038-9af3-cbfb8211b261 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:03.238583 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8d421ad7-9183-4038-9af3-cbfb8211b261 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:03.245046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d421ad7-9183-4038-9af3-cbfb8211b261 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:03.246120 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d421ad7-9183-4038-9af3-cbfb8211b261 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:03.246909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d421ad7-9183-4038-9af3-cbfb8211b261 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:03.247344 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d421ad7-9183-4038-9af3-cbfb8211b261 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:03.382968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8d421ad7-9183-4038-9af3-cbfb8211b261 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:03.391108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8d421ad7-9183-4038-9af3-cbfb8211b261 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.157085 Jun 22 09:09:03.391684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 117/249] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:03 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:03.782610 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fe004319-defd-48b0-82d9-81f31232da14 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:03.783731 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-fe004319-defd-48b0-82d9-81f31232da14 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:03.789628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fe004319-defd-48b0-82d9-81f31232da14 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:03.790072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fe004319-defd-48b0-82d9-81f31232da14 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:03.791083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fe004319-defd-48b0-82d9-81f31232da14 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:03.791295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fe004319-defd-48b0-82d9-81f31232da14 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:03.813523 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fe004319-defd-48b0-82d9-81f31232da14 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/ips" status: 200 len: 150 microversion: 2.1 time: 0.034682 Jun 22 09:09:03.814087 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 133/250] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:09:03 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:04.408213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-805bc27a-626c-40fb-8217-2f7e6b4b2c96 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:04.410633 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-805bc27a-626c-40fb-8217-2f7e6b4b2c96 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:04.410887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-be4f8c55-915a-411d-91d9-9cf3b0d5c334 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82363130-40c5-4180-922f-dce9340d8373"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:04.410887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-be4f8c55-915a-411d-91d9-9cf3b0d5c334 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:04.415939 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-805bc27a-626c-40fb-8217-2f7e6b4b2c96 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:04.416279 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-805bc27a-626c-40fb-8217-2f7e6b4b2c96 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:04.416758 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-be4f8c55-915a-411d-91d9-9cf3b0d5c334 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:04.417038 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-805bc27a-626c-40fb-8217-2f7e6b4b2c96 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:04.417235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-be4f8c55-915a-411d-91d9-9cf3b0d5c334 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:04.417548 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-805bc27a-626c-40fb-8217-2f7e6b4b2c96 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:04.417968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-be4f8c55-915a-411d-91d9-9cf3b0d5c334 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:04.418600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-be4f8c55-915a-411d-91d9-9cf3b0d5c334 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:04.594114 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-805bc27a-626c-40fb-8217-2f7e6b4b2c96 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:04.601780 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-805bc27a-626c-40fb-8217-2f7e6b4b2c96 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.197578 Jun 22 09:09:04.602776 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 118/251] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:04 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:05.619214 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-608260fc-9d39-4b6a-9164-08b571180d69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:05.619852 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-608260fc-9d39-4b6a-9164-08b571180d69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:05.625846 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-608260fc-9d39-4b6a-9164-08b571180d69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:05.626305 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-608260fc-9d39-4b6a-9164-08b571180d69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:05.627068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-608260fc-9d39-4b6a-9164-08b571180d69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:05.627502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-608260fc-9d39-4b6a-9164-08b571180d69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:05.751738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-608260fc-9d39-4b6a-9164-08b571180d69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:05.759271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-608260fc-9d39-4b6a-9164-08b571180d69 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.144135 Jun 22 09:09:05.759879 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 119/252] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:05 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:06.776541 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f7bd5e2a-edae-4232-bd9e-18bba153dfb7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:06.777174 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f7bd5e2a-edae-4232-bd9e-18bba153dfb7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:06.783693 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7bd5e2a-edae-4232-bd9e-18bba153dfb7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:06.784136 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7bd5e2a-edae-4232-bd9e-18bba153dfb7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:06.784887 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7bd5e2a-edae-4232-bd9e-18bba153dfb7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:06.785321 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7bd5e2a-edae-4232-bd9e-18bba153dfb7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:06.910320 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f7bd5e2a-edae-4232-bd9e-18bba153dfb7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:06.913764 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:06.918702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f7bd5e2a-edae-4232-bd9e-18bba153dfb7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.145998 Jun 22 09:09:06.919295 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 120/253] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:06 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:07.656904 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-be4f8c55-915a-411d-91d9-9cf3b0d5c334 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.251486 Jun 22 09:09:07.661052 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 134/254] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:09:04 2022] POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/os-volume_attachments => generated 194 bytes in 3253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:09:07.935947 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-618716e9-ab4a-4391-94dd-e685214f5d18 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:07.936576 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-618716e9-ab4a-4391-94dd-e685214f5d18 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:07.943536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-618716e9-ab4a-4391-94dd-e685214f5d18 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:07.943785 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-618716e9-ab4a-4391-94dd-e685214f5d18 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:07.944535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-618716e9-ab4a-4391-94dd-e685214f5d18 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:07.944964 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-618716e9-ab4a-4391-94dd-e685214f5d18 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:08.082413 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-618716e9-ab4a-4391-94dd-e685214f5d18 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:08.090302 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-618716e9-ab4a-4391-94dd-e685214f5d18 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.158520 Jun 22 09:09:08.090913 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 121/255] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:07 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:08.713273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a64de306-4684-46d1-a791-07eb08d3ef58 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0718f0e-d9df-4b45-8e77-2bf2191b5563"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:08.714546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a64de306-4684-46d1-a791-07eb08d3ef58 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:08.721722 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a64de306-4684-46d1-a791-07eb08d3ef58 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:08.722167 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a64de306-4684-46d1-a791-07eb08d3ef58 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:08.722946 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a64de306-4684-46d1-a791-07eb08d3ef58 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:08.723376 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a64de306-4684-46d1-a791-07eb08d3ef58 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:09.107468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5972898f-8195-47ca-9369-05f85f001ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:09.108056 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5972898f-8195-47ca-9369-05f85f001ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:09.115865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5972898f-8195-47ca-9369-05f85f001ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:09.116437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5972898f-8195-47ca-9369-05f85f001ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:09.117506 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5972898f-8195-47ca-9369-05f85f001ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:09.117988 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5972898f-8195-47ca-9369-05f85f001ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:09.331172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5972898f-8195-47ca-9369-05f85f001ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:09.340747 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5972898f-8195-47ca-9369-05f85f001ee6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.237562 Jun 22 09:09:09.341343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 122/256] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:09 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:09.515080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a64de306-4684-46d1-a791-07eb08d3ef58 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.806408 Jun 22 09:09:09.518474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 135/257] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:09:08 2022] POST /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:10.359720 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-dc917108-5e59-4d3e-b659-73955de46ccc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:10.360422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-dc917108-5e59-4d3e-b659-73955de46ccc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:10.367352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dc917108-5e59-4d3e-b659-73955de46ccc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:10.367801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dc917108-5e59-4d3e-b659-73955de46ccc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:10.368568 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dc917108-5e59-4d3e-b659-73955de46ccc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:10.369003 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dc917108-5e59-4d3e-b659-73955de46ccc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:10.504349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-dc917108-5e59-4d3e-b659-73955de46ccc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:10.512031 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-dc917108-5e59-4d3e-b659-73955de46ccc tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.156265 Jun 22 09:09:10.512597 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 123/258] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:10 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:11.530313 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d4e32f16-04f1-4307-b6e5-cd2c23052d05 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:11.531023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d4e32f16-04f1-4307-b6e5-cd2c23052d05 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:11.537327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4e32f16-04f1-4307-b6e5-cd2c23052d05 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:11.537774 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4e32f16-04f1-4307-b6e5-cd2c23052d05 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:11.538545 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4e32f16-04f1-4307-b6e5-cd2c23052d05 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:11.539006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4e32f16-04f1-4307-b6e5-cd2c23052d05 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:11.671961 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d4e32f16-04f1-4307-b6e5-cd2c23052d05 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:11.680112 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d4e32f16-04f1-4307-b6e5-cd2c23052d05 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.154570 Jun 22 09:09:11.680768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 136/259] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:11 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:12.697530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cee93a80-81d7-4c48-a090-81d27d1cd8e0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:12.698645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cee93a80-81d7-4c48-a090-81d27d1cd8e0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:12.701035 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=52 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:12.705837 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cee93a80-81d7-4c48-a090-81d27d1cd8e0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:12.706281 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cee93a80-81d7-4c48-a090-81d27d1cd8e0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:12.707076 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cee93a80-81d7-4c48-a090-81d27d1cd8e0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:12.707506 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cee93a80-81d7-4c48-a090-81d27d1cd8e0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:12.837717 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cee93a80-81d7-4c48-a090-81d27d1cd8e0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:12.845712 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cee93a80-81d7-4c48-a090-81d27d1cd8e0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.152118 Jun 22 09:09:12.846281 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 124/260] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:12 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:13.862230 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-38a7ce6a-5f36-42c7-a9dc-e941077e0f44 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:13.863021 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-38a7ce6a-5f36-42c7-a9dc-e941077e0f44 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:13.870900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-38a7ce6a-5f36-42c7-a9dc-e941077e0f44 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:13.871347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-38a7ce6a-5f36-42c7-a9dc-e941077e0f44 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:13.872116 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-38a7ce6a-5f36-42c7-a9dc-e941077e0f44 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:13.872548 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-38a7ce6a-5f36-42c7-a9dc-e941077e0f44 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:14.009931 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-38a7ce6a-5f36-42c7-a9dc-e941077e0f44 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:14.018355 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-38a7ce6a-5f36-42c7-a9dc-e941077e0f44 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.159955 Jun 22 09:09:14.018967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 137/261] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:13 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:14.300933 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-101dbc06-8539-44c7-bf24-9f0f9f7f2ec3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c45fc8f-7e4d-431c-845d-6ce295b97d9b", "device": "/dev/sdb"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:14.305041 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-101dbc06-8539-44c7-bf24-9f0f9f7f2ec3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:14.309936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-101dbc06-8539-44c7-bf24-9f0f9f7f2ec3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:14.310656 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-101dbc06-8539-44c7-bf24-9f0f9f7f2ec3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:14.311605 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-101dbc06-8539-44c7-bf24-9f0f9f7f2ec3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:14.312284 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-101dbc06-8539-44c7-bf24-9f0f9f7f2ec3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:15.034780 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-93c6b012-e0a7-4742-9365-85e41fbd9d65 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:15.035350 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-93c6b012-e0a7-4742-9365-85e41fbd9d65 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:15.041800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93c6b012-e0a7-4742-9365-85e41fbd9d65 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:15.042245 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93c6b012-e0a7-4742-9365-85e41fbd9d65 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:15.043024 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93c6b012-e0a7-4742-9365-85e41fbd9d65 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:15.043451 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93c6b012-e0a7-4742-9365-85e41fbd9d65 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:15.187040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-93c6b012-e0a7-4742-9365-85e41fbd9d65 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:15.194471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-93c6b012-e0a7-4742-9365-85e41fbd9d65 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.163610 Jun 22 09:09:15.195060 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 138/262] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:15 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:16.212185 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-34c2a0b7-f714-491d-baaa-f2e45003f3f8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:16.212817 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-34c2a0b7-f714-491d-baaa-f2e45003f3f8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:16.219863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-34c2a0b7-f714-491d-baaa-f2e45003f3f8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:16.220306 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-34c2a0b7-f714-491d-baaa-f2e45003f3f8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:16.221059 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-34c2a0b7-f714-491d-baaa-f2e45003f3f8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:16.221490 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-34c2a0b7-f714-491d-baaa-f2e45003f3f8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:16.353229 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-34c2a0b7-f714-491d-baaa-f2e45003f3f8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:16.361101 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-34c2a0b7-f714-491d-baaa-f2e45003f3f8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.152711 Jun 22 09:09:16.362718 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 139/263] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:16 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:17.336190 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-101dbc06-8539-44c7-bf24-9f0f9f7f2ec3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "POST /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.038969 Jun 22 09:09:17.336801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 125/264] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:09:14 2022] POST /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25/os-volume_attachments => generated 194 bytes in 3040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:17.378542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-90faa686-befb-412b-80ed-f70e6387a6e8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:17.379665 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-90faa686-befb-412b-80ed-f70e6387a6e8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:17.388381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-90faa686-befb-412b-80ed-f70e6387a6e8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.392869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-90faa686-befb-412b-80ed-f70e6387a6e8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:17.392869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-90faa686-befb-412b-80ed-f70e6387a6e8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.392869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-90faa686-befb-412b-80ed-f70e6387a6e8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:17.526293 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-90faa686-befb-412b-80ed-f70e6387a6e8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:17.533683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-90faa686-befb-412b-80ed-f70e6387a6e8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1501 microversion: 2.1 time: 0.159564 Jun 22 09:09:17.534238 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 140/265] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:17 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:17.550303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "771b8bbe-e832-4524-b915-8b86c9da80d7"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:17.551517 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:17.557594 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.558030 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:17.559298 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.559721 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:17.582667 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] HTTP exception thrown: Cannot 'attach_volume' instance cf015553-3a8f-459a-a15a-f269b6d3dae6 while it is in vm_state rescued Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Request method failure captured: Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: POST /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6/os-volume_attachments HTTP/1.1 Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 74 Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvHffkrcURPh5_p8DJ-OorG_jbpSa-9p7eRx2v0zUADKz4LoPZtA5Q_L-q42DvwL6rJ9BAkjazfPS3Q0VCpFJjRznzp8sl5hkv1cyTFXp8TvntWMEfIgtZqeRDBE9-1QqNO_TS597PJxaXTlyTT82OW19HSLE8KvEstAKAWo3BcBBM Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:09:17.584440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}] Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 71ac6423996b4e5d906de9ff6986fb03 Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {"volumeAttachment": {"volumeId": "771b8bbe-e832-4524-b915-8b86c9da80d7"}} Jun 22 09:09:17.586240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Cannot 'attach_volume' instance cf015553-3a8f-459a-a15a-f269b6d3dae6 while it is in vm_state rescued Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'server_id': 'cf015553-3a8f-459a-a15a-f269b6d3dae6', 'body': {'volumeAttachment': {'volumeId': '771b8bbe-e832-4524-b915-8b86c9da80d7'}}} Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cf015553-3a8f-459a-a15a-f269b6d3dae6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:09:17.596702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cf015553-3a8f-459a-a15a-f269b6d3dae6 while it is in vm_state rescued Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:17.599065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:17.602249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:09:17.602249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:09:17.602249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cf015553-3a8f-459a-a15a-f269b6d3dae6 while it is in vm_state rescued Jun 22 09:09:17.602249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:09:17.602249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Returning 409 to user: Cannot 'attach_volume' instance cf015553-3a8f-459a-a15a-f269b6d3dae6 while it is in vm_state rescued {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:09:17.602249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a96ded3b-3357-4204-bce5-841620636c9e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039850 Jun 22 09:09:17.602249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 126/266] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:09:17 2022] POST /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 09:09:17.602777 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4702e953-c3dd-4632-82d5-e83ebe8bdec8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:17.602777 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4702e953-c3dd-4632-82d5-e83ebe8bdec8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:17.604273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4702e953-c3dd-4632-82d5-e83ebe8bdec8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.604719 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4702e953-c3dd-4632-82d5-e83ebe8bdec8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:17.605539 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4702e953-c3dd-4632-82d5-e83ebe8bdec8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.605971 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4702e953-c3dd-4632-82d5-e83ebe8bdec8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:17.610055 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:17.924486 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4702e953-c3dd-4632-82d5-e83ebe8bdec8 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6/action" status: 202 len: 0 microversion: 2.1 time: 0.333252 Jun 22 09:09:17.925140 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 141/267] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:09:17 2022] POST /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:09:17.933277 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cea99568-5fa7-44b2-8987-1de3cc95200a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:17.934498 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cea99568-5fa7-44b2-8987-1de3cc95200a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:17.941161 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cea99568-5fa7-44b2-8987-1de3cc95200a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.941552 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cea99568-5fa7-44b2-8987-1de3cc95200a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:17.942303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cea99568-5fa7-44b2-8987-1de3cc95200a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.942734 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cea99568-5fa7-44b2-8987-1de3cc95200a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:18.102031 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cea99568-5fa7-44b2-8987-1de3cc95200a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:18.110199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cea99568-5fa7-44b2-8987-1de3cc95200a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1509 microversion: 2.1 time: 0.180815 Jun 22 09:09:18.111014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 127/268] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:17 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:18.393815 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ac73814e-a393-44af-9ad2-cb39e39edb85 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:18.403535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac73814e-a393-44af-9ad2-cb39e39edb85 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:18.404135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac73814e-a393-44af-9ad2-cb39e39edb85 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:18.465950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ac73814e-a393-44af-9ad2-cb39e39edb85 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Going to try to stop instance {{(pid=118268) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 09:09:18.660271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ac73814e-a393-44af-9ad2-cb39e39edb85 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/action" status: 202 len: 0 microversion: 2.1 time: 0.271219 Jun 22 09:09:18.660984 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 142/269] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:09:18 2022] POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:09:18.669942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-638b7757-92c9-4f0e-b10b-8f3e53bfddf7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:18.670545 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-638b7757-92c9-4f0e-b10b-8f3e53bfddf7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:18.676559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-638b7757-92c9-4f0e-b10b-8f3e53bfddf7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:18.677020 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-638b7757-92c9-4f0e-b10b-8f3e53bfddf7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:18.677752 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-638b7757-92c9-4f0e-b10b-8f3e53bfddf7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:18.678185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-638b7757-92c9-4f0e-b10b-8f3e53bfddf7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:18.807335 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-638b7757-92c9-4f0e-b10b-8f3e53bfddf7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:18.816484 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-638b7757-92c9-4f0e-b10b-8f3e53bfddf7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.151064 Jun 22 09:09:18.817350 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 128/270] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:18 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:19.128222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-26f0b67f-4ba6-41d0-b534-426037e78636 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:19.128910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-26f0b67f-4ba6-41d0-b534-426037e78636 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:19.135113 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-26f0b67f-4ba6-41d0-b534-426037e78636 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.135557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-26f0b67f-4ba6-41d0-b534-426037e78636 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.136307 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-26f0b67f-4ba6-41d0-b534-426037e78636 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.136739 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-26f0b67f-4ba6-41d0-b534-426037e78636 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.266488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-26f0b67f-4ba6-41d0-b534-426037e78636 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:19.274091 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-26f0b67f-4ba6-41d0-b534-426037e78636 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1509 microversion: 2.1 time: 0.150141 Jun 22 09:09:19.274769 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 143/271] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:19 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:19.835444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d6c55828-7b6d-47fc-a9cc-ca918a150566 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:19.836126 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d6c55828-7b6d-47fc-a9cc-ca918a150566 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:19.843693 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6c55828-7b6d-47fc-a9cc-ca918a150566 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.844325 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6c55828-7b6d-47fc-a9cc-ca918a150566 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.845192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6c55828-7b6d-47fc-a9cc-ca918a150566 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.845723 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6c55828-7b6d-47fc-a9cc-ca918a150566 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.981053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d6c55828-7b6d-47fc-a9cc-ca918a150566 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:19.990277 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d6c55828-7b6d-47fc-a9cc-ca918a150566 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.158761 Jun 22 09:09:19.990879 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 129/272] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:19 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:20.292043 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-eae0ab8c-56e6-43c3-b895-ca42975521c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:20.292659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-eae0ab8c-56e6-43c3-b895-ca42975521c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:20.295535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=54 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:20.300257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-eae0ab8c-56e6-43c3-b895-ca42975521c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:20.300697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-eae0ab8c-56e6-43c3-b895-ca42975521c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:20.301439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-eae0ab8c-56e6-43c3-b895-ca42975521c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:20.301869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-eae0ab8c-56e6-43c3-b895-ca42975521c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:20.446414 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-eae0ab8c-56e6-43c3-b895-ca42975521c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:20.454172 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-eae0ab8c-56e6-43c3-b895-ca42975521c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1509 microversion: 2.1 time: 0.165876 Jun 22 09:09:20.454741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 144/273] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:20 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:21.008327 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9b7851af-c79f-4f7f-84d0-90131137e152 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:21.008934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9b7851af-c79f-4f7f-84d0-90131137e152 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:21.016633 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b7851af-c79f-4f7f-84d0-90131137e152 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:21.017074 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b7851af-c79f-4f7f-84d0-90131137e152 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:21.017826 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b7851af-c79f-4f7f-84d0-90131137e152 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:21.018254 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b7851af-c79f-4f7f-84d0-90131137e152 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:21.146815 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9b7851af-c79f-4f7f-84d0-90131137e152 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:21.155159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9b7851af-c79f-4f7f-84d0-90131137e152 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.150541 Jun 22 09:09:21.155782 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 130/274] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:21 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:21.471714 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7e0440e0-5f20-4958-9bd0-e45157b610ef tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:21.472322 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7e0440e0-5f20-4958-9bd0-e45157b610ef tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:21.479037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7e0440e0-5f20-4958-9bd0-e45157b610ef tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:21.479488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7e0440e0-5f20-4958-9bd0-e45157b610ef tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:21.480236 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7e0440e0-5f20-4958-9bd0-e45157b610ef tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:21.480692 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7e0440e0-5f20-4958-9bd0-e45157b610ef tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:21.610096 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7e0440e0-5f20-4958-9bd0-e45157b610ef tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:21.618479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7e0440e0-5f20-4958-9bd0-e45157b610ef tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1509 microversion: 2.1 time: 0.150531 Jun 22 09:09:21.619086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 145/275] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:21 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:22.172975 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f1e8ba3d-10b7-4741-8b72-b655f713726a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:22.173587 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f1e8ba3d-10b7-4741-8b72-b655f713726a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:22.180164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1e8ba3d-10b7-4741-8b72-b655f713726a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.180614 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1e8ba3d-10b7-4741-8b72-b655f713726a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.181370 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1e8ba3d-10b7-4741-8b72-b655f713726a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.181805 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1e8ba3d-10b7-4741-8b72-b655f713726a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.318890 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f1e8ba3d-10b7-4741-8b72-b655f713726a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:22.327286 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f1e8ba3d-10b7-4741-8b72-b655f713726a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.159052 Jun 22 09:09:22.327847 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 131/276] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:22 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:22.642384 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-da242a85-3793-45c0-8f84-5ed92075fde9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:22.643015 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-da242a85-3793-45c0-8f84-5ed92075fde9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:22.650131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da242a85-3793-45c0-8f84-5ed92075fde9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.650677 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da242a85-3793-45c0-8f84-5ed92075fde9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.651731 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da242a85-3793-45c0-8f84-5ed92075fde9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.652247 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da242a85-3793-45c0-8f84-5ed92075fde9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.787588 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-da242a85-3793-45c0-8f84-5ed92075fde9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:22.795211 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-da242a85-3793-45c0-8f84-5ed92075fde9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1515 microversion: 2.1 time: 0.157004 Jun 22 09:09:22.795777 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 146/277] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:22 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:23.344405 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-71af4417-94da-42a0-a27f-e6b54e56a9cf tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:23.345005 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-71af4417-94da-42a0-a27f-e6b54e56a9cf tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:23.352129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71af4417-94da-42a0-a27f-e6b54e56a9cf tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:23.352576 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71af4417-94da-42a0-a27f-e6b54e56a9cf tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:23.353366 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71af4417-94da-42a0-a27f-e6b54e56a9cf tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:23.353806 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71af4417-94da-42a0-a27f-e6b54e56a9cf tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:23.488628 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-71af4417-94da-42a0-a27f-e6b54e56a9cf tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:23.496528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-71af4417-94da-42a0-a27f-e6b54e56a9cf tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.156481 Jun 22 09:09:23.498024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 132/278] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:23 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:24.519262 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a142a41e-4d3b-4627-ad87-a856f13ef6e6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:24.519262 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a142a41e-4d3b-4627-ad87-a856f13ef6e6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:24.522971 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a142a41e-4d3b-4627-ad87-a856f13ef6e6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:24.523420 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a142a41e-4d3b-4627-ad87-a856f13ef6e6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:24.524189 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a142a41e-4d3b-4627-ad87-a856f13ef6e6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:24.524641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a142a41e-4d3b-4627-ad87-a856f13ef6e6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:24.526734 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-739babbb-72bf-4d8e-882e-7e7f0a0e2137 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'create', calling method: .version_select at 0x7f500e730670>, body: {"keypair": {"name": "tempest-keypair-422898440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN2t2odoE7XtkQLoc9hxxT4pKC1noI7gxVQfnOhWS4KAX6BlHiH46T9SzyfupAobA4OpJALqY2aKzZ3MvFuJHmmabsmemf0RUiuNKnhhyDMvcAyG3kGFpofACHFLJmm4w=="}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:24.541211 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-739babbb-72bf-4d8e-882e-7e7f0a0e2137 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Getting quotas for project aa1c1626dad34ae9a2216e46ffae4003. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:24.545783 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-739babbb-72bf-4d8e-882e-7e7f0a0e2137 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Getting quotas for user 71ac6423996b4e5d906de9ff6986fb03 and project aa1c1626dad34ae9a2216e46ffae4003. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:24.602629 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-739babbb-72bf-4d8e-882e-7e7f0a0e2137 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080647 Jun 22 09:09:24.603284 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 133/279] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:09:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:09:24.660274 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a142a41e-4d3b-4627-ad87-a856f13ef6e6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:24.668345 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a142a41e-4d3b-4627-ad87-a856f13ef6e6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.158541 Jun 22 09:09:24.668904 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 147/280] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:24 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:25.686634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a59db54b-0bd9-4c7b-91b3-7dee0e256756 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:25.687441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a59db54b-0bd9-4c7b-91b3-7dee0e256756 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:25.693996 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a59db54b-0bd9-4c7b-91b3-7dee0e256756 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:25.696533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a59db54b-0bd9-4c7b-91b3-7dee0e256756 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:25.696533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a59db54b-0bd9-4c7b-91b3-7dee0e256756 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:25.696533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a59db54b-0bd9-4c7b-91b3-7dee0e256756 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:25.918494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a59db54b-0bd9-4c7b-91b3-7dee0e256756 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:25.931257 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a59db54b-0bd9-4c7b-91b3-7dee0e256756 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.249366 Jun 22 09:09:25.931754 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 134/281] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:25 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:26.813380 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-7331534", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b36bc90f-3b6b-474d-8af3-dd7768321d61"}], "security_groups": [{"name": "tempest-securitygroup--1302366537"}], "key_name": "tempest-keypair-422898440", "user_data": "}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:26.914649 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] validate_networks() for [('b36bc90f-3b6b-474d-8af3-dd7768321d61', None, None, None, None, None)] {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:09:26.948158 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-498e4808-a832-442a-bdfe-e0f8f1cbb7d1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:26.948833 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-498e4808-a832-442a-bdfe-e0f8f1cbb7d1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:26.955807 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-498e4808-a832-442a-bdfe-e0f8f1cbb7d1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:26.956262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-498e4808-a832-442a-bdfe-e0f8f1cbb7d1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:26.957023 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-498e4808-a832-442a-bdfe-e0f8f1cbb7d1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:26.957568 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-498e4808-a832-442a-bdfe-e0f8f1cbb7d1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:27.088449 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-498e4808-a832-442a-bdfe-e0f8f1cbb7d1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:27.096408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-498e4808-a832-442a-bdfe-e0f8f1cbb7d1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.152104 Jun 22 09:09:27.096975 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 135/282] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:26 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:27.288849 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:09:27.289270 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:09:27.289734 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:09:27.290135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:09:27.290550 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:09:27.299664 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:27.300113 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:27.300904 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:27.301342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:27.318249 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Getting quotas for project aa1c1626dad34ae9a2216e46ffae4003. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:27.322143 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Getting quotas for user 71ac6423996b4e5d906de9ff6986fb03 and project aa1c1626dad34ae9a2216e46ffae4003. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:27.335535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:09:27.337797 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:09:27.453316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-99de06b7-ebe1-4869-acb4-94a902937a20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.644297 Jun 22 09:09:27.453958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 148/283] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:09:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:09:27.464067 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-647344bf-a17c-4dac-ba26-23c4d58edf7a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:27.464778 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-647344bf-a17c-4dac-ba26-23c4d58edf7a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:27.523721 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-647344bf-a17c-4dac-ba26-23c4d58edf7a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:27.531245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-647344bf-a17c-4dac-ba26-23c4d58edf7a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1242 microversion: 2.1 time: 0.071229 Jun 22 09:09:27.532236 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 136/284] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:27 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:28.115149 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a6c5024a-6411-4028-b24d-092e5b945278 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:28.115679 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a6c5024a-6411-4028-b24d-092e5b945278 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:28.122459 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6c5024a-6411-4028-b24d-092e5b945278 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:28.122936 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6c5024a-6411-4028-b24d-092e5b945278 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:28.124268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6c5024a-6411-4028-b24d-092e5b945278 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:28.124690 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6c5024a-6411-4028-b24d-092e5b945278 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:28.260712 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a6c5024a-6411-4028-b24d-092e5b945278 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:28.269026 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a6c5024a-6411-4028-b24d-092e5b945278 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.158446 Jun 22 09:09:28.277557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 149/285] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:28 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:28.549457 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-14329dcf-caec-478e-9c19-f14d278ebfab tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:28.550070 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-14329dcf-caec-478e-9c19-f14d278ebfab tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:28.556665 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-14329dcf-caec-478e-9c19-f14d278ebfab tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:28.557129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-14329dcf-caec-478e-9c19-f14d278ebfab tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:28.557882 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-14329dcf-caec-478e-9c19-f14d278ebfab tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:28.558324 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-14329dcf-caec-478e-9c19-f14d278ebfab tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:28.621667 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-14329dcf-caec-478e-9c19-f14d278ebfab tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:28.629990 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-14329dcf-caec-478e-9c19-f14d278ebfab tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1246 microversion: 2.1 time: 0.084449 Jun 22 09:09:28.630551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 137/286] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:28 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:29.286237 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f0209ed4-11e2-4940-a12a-e0be62a16ac8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:29.286768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f0209ed4-11e2-4940-a12a-e0be62a16ac8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:29.293609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f0209ed4-11e2-4940-a12a-e0be62a16ac8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:29.294062 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f0209ed4-11e2-4940-a12a-e0be62a16ac8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:29.294838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f0209ed4-11e2-4940-a12a-e0be62a16ac8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:29.295284 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f0209ed4-11e2-4940-a12a-e0be62a16ac8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:29.435408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f0209ed4-11e2-4940-a12a-e0be62a16ac8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:29.443745 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f0209ed4-11e2-4940-a12a-e0be62a16ac8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.161577 Jun 22 09:09:29.444298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 150/287] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:29 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:29.651254 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-886750d6-262f-40a0-9a34-68b2f87d2ed9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:29.651901 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-886750d6-262f-40a0-9a34-68b2f87d2ed9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:29.658645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-886750d6-262f-40a0-9a34-68b2f87d2ed9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:29.659129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-886750d6-262f-40a0-9a34-68b2f87d2ed9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:29.659891 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-886750d6-262f-40a0-9a34-68b2f87d2ed9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:29.660327 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-886750d6-262f-40a0-9a34-68b2f87d2ed9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:29.681007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:29.723562 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-886750d6-262f-40a0-9a34-68b2f87d2ed9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:29.731348 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-886750d6-262f-40a0-9a34-68b2f87d2ed9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1246 microversion: 2.1 time: 0.087576 Jun 22 09:09:29.731919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 138/288] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:29 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:30.461243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bf151c03-5686-4d7f-8ffb-553c3975a9b6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:30.461886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bf151c03-5686-4d7f-8ffb-553c3975a9b6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:30.468308 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bf151c03-5686-4d7f-8ffb-553c3975a9b6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:30.468753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bf151c03-5686-4d7f-8ffb-553c3975a9b6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:30.469506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bf151c03-5686-4d7f-8ffb-553c3975a9b6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:30.469942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bf151c03-5686-4d7f-8ffb-553c3975a9b6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:30.595465 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bf151c03-5686-4d7f-8ffb-553c3975a9b6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:30.603655 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bf151c03-5686-4d7f-8ffb-553c3975a9b6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.146212 Jun 22 09:09:30.604209 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 151/289] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:30 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:30.749038 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fa0209c7-34b1-46ea-b51e-6be830dfa584 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:30.749793 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fa0209c7-34b1-46ea-b51e-6be830dfa584 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:30.756877 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fa0209c7-34b1-46ea-b51e-6be830dfa584 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:30.757313 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fa0209c7-34b1-46ea-b51e-6be830dfa584 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:30.758052 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fa0209c7-34b1-46ea-b51e-6be830dfa584 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:30.758473 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fa0209c7-34b1-46ea-b51e-6be830dfa584 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:30.818161 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fa0209c7-34b1-46ea-b51e-6be830dfa584 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:30.825413 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fa0209c7-34b1-46ea-b51e-6be830dfa584 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1246 microversion: 2.1 time: 0.080804 Jun 22 09:09:30.825966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 139/290] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:30 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:31.621639 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fb75c761-6857-45f2-8573-81b276a038d9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:31.622400 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-fb75c761-6857-45f2-8573-81b276a038d9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:31.629443 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fb75c761-6857-45f2-8573-81b276a038d9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:31.629889 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fb75c761-6857-45f2-8573-81b276a038d9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:31.630648 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fb75c761-6857-45f2-8573-81b276a038d9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:31.631108 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fb75c761-6857-45f2-8573-81b276a038d9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:31.768285 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fb75c761-6857-45f2-8573-81b276a038d9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:31.773195 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fb75c761-6857-45f2-8573-81b276a038d9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.155474 Jun 22 09:09:31.773760 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 152/291] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:31 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:31.843305 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4f277217-42a3-4e68-9283-546f342f496c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:31.843840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4f277217-42a3-4e68-9283-546f342f496c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:31.850882 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f277217-42a3-4e68-9283-546f342f496c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:31.851337 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f277217-42a3-4e68-9283-546f342f496c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:31.852105 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f277217-42a3-4e68-9283-546f342f496c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:31.852538 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f277217-42a3-4e68-9283-546f342f496c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:31.915586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4f277217-42a3-4e68-9283-546f342f496c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:31.923342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4f277217-42a3-4e68-9283-546f342f496c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1246 microversion: 2.1 time: 0.084481 Jun 22 09:09:31.923909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 140/292] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:31 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:32.790364 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6ab81683-66da-4f1b-a301-ce65a41c0bac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:32.791106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6ab81683-66da-4f1b-a301-ce65a41c0bac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:32.798080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ab81683-66da-4f1b-a301-ce65a41c0bac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:32.798555 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ab81683-66da-4f1b-a301-ce65a41c0bac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:32.799345 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ab81683-66da-4f1b-a301-ce65a41c0bac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:32.799776 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ab81683-66da-4f1b-a301-ce65a41c0bac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:32.932949 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6ab81683-66da-4f1b-a301-ce65a41c0bac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:32.940267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-dc26c4cb-dcaf-4fdf-bdf3-fb1aa9956977 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:32.940884 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-dc26c4cb-dcaf-4fdf-bdf3-fb1aa9956977 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:32.942163 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6ab81683-66da-4f1b-a301-ce65a41c0bac tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.155440 Jun 22 09:09:32.943059 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 153/293] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:32 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:32.947628 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dc26c4cb-dcaf-4fdf-bdf3-fb1aa9956977 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:32.948080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dc26c4cb-dcaf-4fdf-bdf3-fb1aa9956977 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:32.948846 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dc26c4cb-dcaf-4fdf-bdf3-fb1aa9956977 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:32.949308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dc26c4cb-dcaf-4fdf-bdf3-fb1aa9956977 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:33.015116 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-dc26c4cb-dcaf-4fdf-bdf3-fb1aa9956977 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:33.022960 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-dc26c4cb-dcaf-4fdf-bdf3-fb1aa9956977 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1246 microversion: 2.1 time: 0.086903 Jun 22 09:09:33.023533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 141/294] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:32 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:33.960241 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ac567b85-587f-48d3-989e-7aa5161a4fb8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:33.960843 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ac567b85-587f-48d3-989e-7aa5161a4fb8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:33.967312 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac567b85-587f-48d3-989e-7aa5161a4fb8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:33.967759 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac567b85-587f-48d3-989e-7aa5161a4fb8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:33.968508 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac567b85-587f-48d3-989e-7aa5161a4fb8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:33.968939 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac567b85-587f-48d3-989e-7aa5161a4fb8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:34.040106 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fe51b333-d6d9-4be9-8a8d-fbe35a7967ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:34.040690 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fe51b333-d6d9-4be9-8a8d-fbe35a7967ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:34.048542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fe51b333-d6d9-4be9-8a8d-fbe35a7967ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:34.048984 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fe51b333-d6d9-4be9-8a8d-fbe35a7967ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:34.049751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fe51b333-d6d9-4be9-8a8d-fbe35a7967ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:34.050177 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fe51b333-d6d9-4be9-8a8d-fbe35a7967ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:34.113991 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fe51b333-d6d9-4be9-8a8d-fbe35a7967ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:34.122214 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fe51b333-d6d9-4be9-8a8d-fbe35a7967ae tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1246 microversion: 2.1 time: 0.085841 Jun 22 09:09:34.123577 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 142/295] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:34 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:34.233748 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ac567b85-587f-48d3-989e-7aa5161a4fb8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:34.241876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ac567b85-587f-48d3-989e-7aa5161a4fb8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.285486 Jun 22 09:09:34.242436 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 154/296] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:33 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:35.140380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1b971d33-e2a1-4aa3-bad2-7579a3522ec9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:35.141029 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1b971d33-e2a1-4aa3-bad2-7579a3522ec9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:35.147364 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1b971d33-e2a1-4aa3-bad2-7579a3522ec9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:35.147834 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1b971d33-e2a1-4aa3-bad2-7579a3522ec9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:35.148598 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1b971d33-e2a1-4aa3-bad2-7579a3522ec9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:35.149031 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1b971d33-e2a1-4aa3-bad2-7579a3522ec9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:35.209344 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1b971d33-e2a1-4aa3-bad2-7579a3522ec9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:35.217359 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1b971d33-e2a1-4aa3-bad2-7579a3522ec9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1246 microversion: 2.1 time: 0.080736 Jun 22 09:09:35.217918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 143/297] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:35 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:35.259153 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-814c3d07-2649-49bb-bcf8-c65b1a85f148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:35.259752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-814c3d07-2649-49bb-bcf8-c65b1a85f148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:35.266417 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-814c3d07-2649-49bb-bcf8-c65b1a85f148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:35.266882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-814c3d07-2649-49bb-bcf8-c65b1a85f148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:35.267659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-814c3d07-2649-49bb-bcf8-c65b1a85f148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:35.268085 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-814c3d07-2649-49bb-bcf8-c65b1a85f148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:35.394770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-814c3d07-2649-49bb-bcf8-c65b1a85f148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:35.402587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-814c3d07-2649-49bb-bcf8-c65b1a85f148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.147194 Jun 22 09:09:35.403177 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 155/298] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:35 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:36.233564 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ef40cb2d-bc1f-4a0f-a207-00429e16eeee tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:36.234172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ef40cb2d-bc1f-4a0f-a207-00429e16eeee tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:36.240658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef40cb2d-bc1f-4a0f-a207-00429e16eeee tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:36.241111 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef40cb2d-bc1f-4a0f-a207-00429e16eeee tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:36.241864 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef40cb2d-bc1f-4a0f-a207-00429e16eeee tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:36.242304 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef40cb2d-bc1f-4a0f-a207-00429e16eeee tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:36.306336 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ef40cb2d-bc1f-4a0f-a207-00429e16eeee tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:36.314140 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ef40cb2d-bc1f-4a0f-a207-00429e16eeee tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1246 microversion: 2.1 time: 0.084429 Jun 22 09:09:36.314701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 144/299] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:36 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:36.420119 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4701bba2-24b5-4285-8617-fdc587dd492c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:36.420646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4701bba2-24b5-4285-8617-fdc587dd492c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:36.427012 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4701bba2-24b5-4285-8617-fdc587dd492c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:36.427466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4701bba2-24b5-4285-8617-fdc587dd492c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:36.428228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4701bba2-24b5-4285-8617-fdc587dd492c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:36.428660 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4701bba2-24b5-4285-8617-fdc587dd492c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:36.447806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:36.556295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4701bba2-24b5-4285-8617-fdc587dd492c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:36.564119 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4701bba2-24b5-4285-8617-fdc587dd492c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.148909 Jun 22 09:09:36.568932 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 156/300] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:36 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:37.331269 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1f5de452-f100-40d4-a308-dcda60b4079c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:37.331961 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1f5de452-f100-40d4-a308-dcda60b4079c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:37.338585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1f5de452-f100-40d4-a308-dcda60b4079c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:37.339106 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1f5de452-f100-40d4-a308-dcda60b4079c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:37.339868 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1f5de452-f100-40d4-a308-dcda60b4079c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:37.340302 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1f5de452-f100-40d4-a308-dcda60b4079c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:37.405615 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1f5de452-f100-40d4-a308-dcda60b4079c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:37.412994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1f5de452-f100-40d4-a308-dcda60b4079c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1246 microversion: 2.1 time: 0.085486 Jun 22 09:09:37.422425 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 145/301] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:37 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:37.582255 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-70d01571-7441-461b-8836-4500b5e089a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:37.582885 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-70d01571-7441-461b-8836-4500b5e089a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:37.585030 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:37.585665 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=6 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:37.591294 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70d01571-7441-461b-8836-4500b5e089a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:37.592650 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70d01571-7441-461b-8836-4500b5e089a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:37.592650 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70d01571-7441-461b-8836-4500b5e089a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:37.593023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70d01571-7441-461b-8836-4500b5e089a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:37.723046 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-70d01571-7441-461b-8836-4500b5e089a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:37.733250 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-70d01571-7441-461b-8836-4500b5e089a4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.154872 Jun 22 09:09:37.741798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 157/302] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:37 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:38.429334 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cefb5dff-58ef-47be-a415-d62eb88071f2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:38.429941 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cefb5dff-58ef-47be-a415-d62eb88071f2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:38.431792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=6 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:38.437390 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cefb5dff-58ef-47be-a415-d62eb88071f2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:38.437833 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cefb5dff-58ef-47be-a415-d62eb88071f2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:38.438586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cefb5dff-58ef-47be-a415-d62eb88071f2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:38.439081 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cefb5dff-58ef-47be-a415-d62eb88071f2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:38.502372 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cefb5dff-58ef-47be-a415-d62eb88071f2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:38.509716 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cefb5dff-58ef-47be-a415-d62eb88071f2 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1294 microversion: 2.1 time: 0.084213 Jun 22 09:09:38.510310 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 146/303] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:38 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:38.750511 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f3849516-ac83-4822-98cf-a68a3f7a9d60 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:38.751153 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f3849516-ac83-4822-98cf-a68a3f7a9d60 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:38.758142 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f3849516-ac83-4822-98cf-a68a3f7a9d60 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:38.758927 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f3849516-ac83-4822-98cf-a68a3f7a9d60 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:38.764840 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f3849516-ac83-4822-98cf-a68a3f7a9d60 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:38.765506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f3849516-ac83-4822-98cf-a68a3f7a9d60 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:38.899999 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f3849516-ac83-4822-98cf-a68a3f7a9d60 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:38.908477 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f3849516-ac83-4822-98cf-a68a3f7a9d60 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.162363 Jun 22 09:09:38.913918 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 158/304] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:38 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:39.185850 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-739c002b-fb39-4aa4-becc-80d101fb17a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: .version_select at 0x7f5010c4c940>, body: {"keypair": {"name": "tempest-keypair-1472394792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+bJz22UjfSVsjH/jEDtcZHzmaZ73jldZM+5kKRPixcNPjOeSmmNktSdSeg9PGe3ImG2iHdAFjVJ7UwioTUUwdhQqIPB3SUaQ0lzknbafcJUf/Uy56q+upMMICMPJtD8g=="}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:39.201605 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-739c002b-fb39-4aa4-becc-80d101fb17a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:39.205575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-739c002b-fb39-4aa4-becc-80d101fb17a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for user 0673a8903f56430f86f87b9447668300 and project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:39.315664 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-739c002b-fb39-4aa4-becc-80d101fb17a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134660 Jun 22 09:09:39.316467 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 147/305] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:09:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:09:39.527345 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cf1d88bf-a833-4cae-8fa7-5a308241a458 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:39.527947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cf1d88bf-a833-4cae-8fa7-5a308241a458 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:39.534818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf1d88bf-a833-4cae-8fa7-5a308241a458 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:39.535301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf1d88bf-a833-4cae-8fa7-5a308241a458 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:39.536078 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf1d88bf-a833-4cae-8fa7-5a308241a458 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:39.536517 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf1d88bf-a833-4cae-8fa7-5a308241a458 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:39.625235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cf1d88bf-a833-4cae-8fa7-5a308241a458 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:39.632831 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cf1d88bf-a833-4cae-8fa7-5a308241a458 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1300 microversion: 2.1 time: 0.109443 Jun 22 09:09:39.633382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 159/306] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:39 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:39.928039 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1cc9e8ff-3b68-406f-b5b9-02015500649d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:39.928936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1cc9e8ff-3b68-406f-b5b9-02015500649d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:39.937241 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1cc9e8ff-3b68-406f-b5b9-02015500649d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:39.937692 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1cc9e8ff-3b68-406f-b5b9-02015500649d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:39.938692 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1cc9e8ff-3b68-406f-b5b9-02015500649d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:39.939351 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1cc9e8ff-3b68-406f-b5b9-02015500649d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.209319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1cc9e8ff-3b68-406f-b5b9-02015500649d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:40.217547 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1cc9e8ff-3b68-406f-b5b9-02015500649d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.295403 Jun 22 09:09:40.218109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 148/307] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:39 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:40.649757 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e0fcf99d-1480-430e-9a0a-cea6956d346f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:40.650373 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e0fcf99d-1480-430e-9a0a-cea6956d346f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:40.662600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0fcf99d-1480-430e-9a0a-cea6956d346f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:40.662600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0fcf99d-1480-430e-9a0a-cea6956d346f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.662600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0fcf99d-1480-430e-9a0a-cea6956d346f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:40.662600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0fcf99d-1480-430e-9a0a-cea6956d346f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.857741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-2b2c928c-f13e-4723-a42d-71d5cbd98901 req-6003a226-0af3-4ec6-b4ff-21c1f90080e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e593a5f-2134-4ca1-95b8-5f2e454dca54", "tag": "c3ed1249-4d90-4b41-b5b8-c3d483a0e086"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:40.880472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-2b2c928c-f13e-4723-a42d-71d5cbd98901 req-6003a226-0af3-4ec6-b4ff-21c1f90080e4 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:40.881113 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-2b2c928c-f13e-4723-a42d-71d5cbd98901 req-6003a226-0af3-4ec6-b4ff-21c1f90080e4 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.897576 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-2b2c928c-f13e-4723-a42d-71d5cbd98901 req-6003a226-0af3-4ec6-b4ff-21c1f90080e4 service nova] Creating event network-changed:c3ed1249-4d90-4b41-b5b8-c3d483a0e086 for instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 on hv-cinder-80382 Jun 22 09:09:40.904905 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-2b2c928c-f13e-4723-a42d-71d5cbd98901 req-6003a226-0af3-4ec6-b4ff-21c1f90080e4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051962 Jun 22 09:09:40.905825 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 149/308] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:40.912932 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e0fcf99d-1480-430e-9a0a-cea6956d346f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:40.921021 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e0fcf99d-1480-430e-9a0a-cea6956d346f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.275248 Jun 22 09:09:40.925567 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 160/309] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:40 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:41.237009 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-69951ae1-d7a8-4251-8394-23fe4c727547 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:41.238508 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-69951ae1-d7a8-4251-8394-23fe4c727547 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:41.246101 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69951ae1-d7a8-4251-8394-23fe4c727547 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:41.246687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69951ae1-d7a8-4251-8394-23fe4c727547 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:41.248408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69951ae1-d7a8-4251-8394-23fe4c727547 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:41.248840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69951ae1-d7a8-4251-8394-23fe4c727547 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:41.506636 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-69951ae1-d7a8-4251-8394-23fe4c727547 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:41.515964 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-69951ae1-d7a8-4251-8394-23fe4c727547 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1723 microversion: 2.1 time: 0.284804 Jun 22 09:09:41.516842 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 150/310] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:41 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:41.938112 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-db0f7776-4664-410a-a52c-a0cdcee8d4db tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:41.938702 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-db0f7776-4664-410a-a52c-a0cdcee8d4db tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:41.947061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-db0f7776-4664-410a-a52c-a0cdcee8d4db tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:41.947678 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-db0f7776-4664-410a-a52c-a0cdcee8d4db tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:41.948335 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-db0f7776-4664-410a-a52c-a0cdcee8d4db tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:41.948705 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-db0f7776-4664-410a-a52c-a0cdcee8d4db tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:41.984540 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-516193306", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "feb2a623-753e-4717-8e5a-c83201989599"}], "security_groups": [{"name": "tempest-securitygroup--336973407"}], "key_name": "tempest-keypair-1472394792", "user_data": "}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:42.086584 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-db0f7776-4664-410a-a52c-a0cdcee8d4db tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:42.095352 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-db0f7776-4664-410a-a52c-a0cdcee8d4db tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.161509 Jun 22 09:09:42.095931 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 161/311] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:41 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:42.341041 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] validate_networks() for [('feb2a623-753e-4717-8e5a-c83201989599', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:09:42.533397 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ca688f05-e9db-45e2-8560-b8a86882e586 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:42.534505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ca688f05-e9db-45e2-8560-b8a86882e586 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:42.542725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ca688f05-e9db-45e2-8560-b8a86882e586 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.543209 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ca688f05-e9db-45e2-8560-b8a86882e586 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.544856 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ca688f05-e9db-45e2-8560-b8a86882e586 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.545294 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ca688f05-e9db-45e2-8560-b8a86882e586 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.676900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ca688f05-e9db-45e2-8560-b8a86882e586 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:42.684954 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ca688f05-e9db-45e2-8560-b8a86882e586 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1700 microversion: 2.1 time: 0.155409 Jun 22 09:09:42.688810 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 162/312] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:42 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:42.701792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6d3b804b-81d7-42cb-b87f-fd8c4d1e0722 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:42.707860 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d3b804b-81d7-42cb-b87f-fd8c4d1e0722 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.708530 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d3b804b-81d7-42cb-b87f-fd8c4d1e0722 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.719586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:09:42.720001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:09:42.720460 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:09:42.720857 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:09:42.721257 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:09:42.732877 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.733468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.734530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.735282 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.735381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6d3b804b-81d7-42cb-b87f-fd8c4d1e0722 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Going to try to start instance {{(pid=118268) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 09:09:42.752185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:42.756542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:42.760691 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for user 0673a8903f56430f86f87b9447668300 and project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:42.775053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:09:42.775053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:09:42.868401 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9f253401-48a2-46a0-ae37-7a9efdcdaadb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.888726 Jun 22 09:09:42.869048 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 151/313] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:09:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 09:09:42.879223 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f12d5a26-8e40-4a0e-a344-c4cd72994359 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:42.879912 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f12d5a26-8e40-4a0e-a344-c4cd72994359 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:42.900510 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6d3b804b-81d7-42cb-b87f-fd8c4d1e0722 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/action" status: 202 len: 0 microversion: 2.1 time: 0.202727 Jun 22 09:09:42.901152 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 163/314] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:09:42 2022] POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:09:42.910037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6d851599-c8e7-4481-99c8-ec057c84244f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:42.922136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6d851599-c8e7-4481-99c8-ec057c84244f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:42.938209 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d851599-c8e7-4481-99c8-ec057c84244f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.938774 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d851599-c8e7-4481-99c8-ec057c84244f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.939583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d851599-c8e7-4481-99c8-ec057c84244f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.940081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d851599-c8e7-4481-99c8-ec057c84244f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.966779 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f12d5a26-8e40-4a0e-a344-c4cd72994359 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:42.974773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f12d5a26-8e40-4a0e-a344-c4cd72994359 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1241 microversion: 2.1 time: 0.099549 Jun 22 09:09:42.975990 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 152/315] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:42 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:43.091879 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6d851599-c8e7-4481-99c8-ec057c84244f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:43.100457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6d851599-c8e7-4481-99c8-ec057c84244f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1709 microversion: 2.1 time: 0.194248 Jun 22 09:09:43.112442 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 164/316] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:42 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1709 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:43.115388 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a41eb9e7-3ddf-4874-a847-2caae45e87a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:43.116291 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a41eb9e7-3ddf-4874-a847-2caae45e87a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:43.131141 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a41eb9e7-3ddf-4874-a847-2caae45e87a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:43.131683 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a41eb9e7-3ddf-4874-a847-2caae45e87a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:43.132525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a41eb9e7-3ddf-4874-a847-2caae45e87a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:43.133053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a41eb9e7-3ddf-4874-a847-2caae45e87a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:43.318671 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a41eb9e7-3ddf-4874-a847-2caae45e87a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:43.327649 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a41eb9e7-3ddf-4874-a847-2caae45e87a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.218214 Jun 22 09:09:43.328221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 153/317] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:43 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:43.992353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b6124ed3-a22b-4306-b457-5c4487b8c3e6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:43.993067 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b6124ed3-a22b-4306-b457-5c4487b8c3e6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:44.000757 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6124ed3-a22b-4306-b457-5c4487b8c3e6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:44.001207 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6124ed3-a22b-4306-b457-5c4487b8c3e6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:44.002467 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6124ed3-a22b-4306-b457-5c4487b8c3e6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:44.002937 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6124ed3-a22b-4306-b457-5c4487b8c3e6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:44.069992 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b6124ed3-a22b-4306-b457-5c4487b8c3e6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:44.092551 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b6124ed3-a22b-4306-b457-5c4487b8c3e6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1245 microversion: 2.1 time: 0.103243 Jun 22 09:09:44.094113 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 165/318] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:43 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:44.129587 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-60965c7f-bd52-432d-b151-48a2ad6b9a52 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:44.130792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-60965c7f-bd52-432d-b151-48a2ad6b9a52 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:44.137364 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-60965c7f-bd52-432d-b151-48a2ad6b9a52 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:44.138053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-60965c7f-bd52-432d-b151-48a2ad6b9a52 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:44.139246 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-60965c7f-bd52-432d-b151-48a2ad6b9a52 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:44.139828 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-60965c7f-bd52-432d-b151-48a2ad6b9a52 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:44.308859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-60965c7f-bd52-432d-b151-48a2ad6b9a52 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:44.317530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-60965c7f-bd52-432d-b151-48a2ad6b9a52 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1709 microversion: 2.1 time: 0.192347 Jun 22 09:09:44.318507 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 154/319] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:44 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1709 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:44.344834 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-44e0be70-fc3c-4cf2-98c5-862134655585 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:44.345441 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-44e0be70-fc3c-4cf2-98c5-862134655585 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:44.352061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-44e0be70-fc3c-4cf2-98c5-862134655585 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:44.352506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-44e0be70-fc3c-4cf2-98c5-862134655585 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:44.353272 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-44e0be70-fc3c-4cf2-98c5-862134655585 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:44.353711 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-44e0be70-fc3c-4cf2-98c5-862134655585 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:44.496684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-44e0be70-fc3c-4cf2-98c5-862134655585 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:44.505299 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-44e0be70-fc3c-4cf2-98c5-862134655585 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.165187 Jun 22 09:09:44.505866 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 166/320] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:44 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:45.110021 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-df547464-57c2-4f04-9a9b-15edded1a12a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:45.110635 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-df547464-57c2-4f04-9a9b-15edded1a12a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:45.116634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-df547464-57c2-4f04-9a9b-15edded1a12a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:45.117065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-df547464-57c2-4f04-9a9b-15edded1a12a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:45.117816 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-df547464-57c2-4f04-9a9b-15edded1a12a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:45.118246 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-df547464-57c2-4f04-9a9b-15edded1a12a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:45.194446 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-df547464-57c2-4f04-9a9b-15edded1a12a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:45.204815 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-df547464-57c2-4f04-9a9b-15edded1a12a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1293 microversion: 2.1 time: 0.098341 Jun 22 09:09:45.205968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 155/321] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:45 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:45.335717 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5632963d-b2e9-4194-97ca-57bc25150995 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:45.336361 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5632963d-b2e9-4194-97ca-57bc25150995 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:45.343014 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5632963d-b2e9-4194-97ca-57bc25150995 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:45.343412 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5632963d-b2e9-4194-97ca-57bc25150995 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:45.344174 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5632963d-b2e9-4194-97ca-57bc25150995 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:45.344611 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5632963d-b2e9-4194-97ca-57bc25150995 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:45.523481 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fb7719d0-423c-4e8a-a068-6f87a138c208 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:45.524583 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fb7719d0-423c-4e8a-a068-6f87a138c208 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:45.531012 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fb7719d0-423c-4e8a-a068-6f87a138c208 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:45.531559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fb7719d0-423c-4e8a-a068-6f87a138c208 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:45.532510 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fb7719d0-423c-4e8a-a068-6f87a138c208 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:45.533108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fb7719d0-423c-4e8a-a068-6f87a138c208 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:45.534136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5632963d-b2e9-4194-97ca-57bc25150995 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:45.543572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5632963d-b2e9-4194-97ca-57bc25150995 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1713 microversion: 2.1 time: 0.212080 Jun 22 09:09:45.544755 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 167/322] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:45 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1713 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:45.746709 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fb7719d0-423c-4e8a-a068-6f87a138c208 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:45.754857 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fb7719d0-423c-4e8a-a068-6f87a138c208 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.235971 Jun 22 09:09:45.755415 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 156/323] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:45 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:46.222198 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-198b6ee9-cf8c-4560-9592-ba74dfe1fe7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:46.223431 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-198b6ee9-cf8c-4560-9592-ba74dfe1fe7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:46.229781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-198b6ee9-cf8c-4560-9592-ba74dfe1fe7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:46.230230 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-198b6ee9-cf8c-4560-9592-ba74dfe1fe7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:46.231466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-198b6ee9-cf8c-4560-9592-ba74dfe1fe7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:46.232325 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-198b6ee9-cf8c-4560-9592-ba74dfe1fe7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:46.302164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-198b6ee9-cf8c-4560-9592-ba74dfe1fe7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:46.310515 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-198b6ee9-cf8c-4560-9592-ba74dfe1fe7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1293 microversion: 2.1 time: 0.091659 Jun 22 09:09:46.311055 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 168/324] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:46 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:46.771353 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-aad64884-42ab-4ca8-b428-be6613885937 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:46.772649 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-aad64884-42ab-4ca8-b428-be6613885937 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:46.779645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aad64884-42ab-4ca8-b428-be6613885937 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:46.780173 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aad64884-42ab-4ca8-b428-be6613885937 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:46.789192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aad64884-42ab-4ca8-b428-be6613885937 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:46.789192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aad64884-42ab-4ca8-b428-be6613885937 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:47.022026 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-aad64884-42ab-4ca8-b428-be6613885937 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:47.030148 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-aad64884-42ab-4ca8-b428-be6613885937 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.262589 Jun 22 09:09:47.030814 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 157/325] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:46 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:47.329713 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-60ff309a-ed5d-4d82-8df7-7cbf93431419 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:47.335938 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-60ff309a-ed5d-4d82-8df7-7cbf93431419 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:47.337718 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-60ff309a-ed5d-4d82-8df7-7cbf93431419 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:47.338368 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-60ff309a-ed5d-4d82-8df7-7cbf93431419 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:47.339349 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-60ff309a-ed5d-4d82-8df7-7cbf93431419 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:47.339787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-60ff309a-ed5d-4d82-8df7-7cbf93431419 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:47.417973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-60ff309a-ed5d-4d82-8df7-7cbf93431419 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:47.427404 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-60ff309a-ed5d-4d82-8df7-7cbf93431419 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1293 microversion: 2.1 time: 0.103695 Jun 22 09:09:47.433109 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 169/326] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:47 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:47.714579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-421939d6-0378-499d-adb3-2d9f7fbcaa19 req-c24cb465-6aa2-4cdf-88e3-6144e763a034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e593a5f-2134-4ca1-95b8-5f2e454dca54", "name": "network-vif-plugged", "status": "completed", "tag": "c3ed1249-4d90-4b41-b5b8-c3d483a0e086"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:47.723252 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-421939d6-0378-499d-adb3-2d9f7fbcaa19 req-c24cb465-6aa2-4cdf-88e3-6144e763a034 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:47.724098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-421939d6-0378-499d-adb3-2d9f7fbcaa19 req-c24cb465-6aa2-4cdf-88e3-6144e763a034 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:47.736774 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-421939d6-0378-499d-adb3-2d9f7fbcaa19 req-c24cb465-6aa2-4cdf-88e3-6144e763a034 service nova] Creating event network-vif-plugged:c3ed1249-4d90-4b41-b5b8-c3d483a0e086 for instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 on hv-cinder-80382 Jun 22 09:09:47.741000 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-421939d6-0378-499d-adb3-2d9f7fbcaa19 req-c24cb465-6aa2-4cdf-88e3-6144e763a034 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030228 Jun 22 09:09:47.741590 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 158/327] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:09:48.048100 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1bced928-7ba8-417e-826c-78f2833cafbd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:48.048713 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1bced928-7ba8-417e-826c-78f2833cafbd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:48.058690 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bced928-7ba8-417e-826c-78f2833cafbd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:48.062943 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bced928-7ba8-417e-826c-78f2833cafbd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:48.063920 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bced928-7ba8-417e-826c-78f2833cafbd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:48.064652 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bced928-7ba8-417e-826c-78f2833cafbd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:48.209554 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1bced928-7ba8-417e-826c-78f2833cafbd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:48.217609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1bced928-7ba8-417e-826c-78f2833cafbd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.174476 Jun 22 09:09:48.218185 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 170/328] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:48 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:48.444669 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4d5de61f-30eb-49c3-9197-952547ec436e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:48.446009 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4d5de61f-30eb-49c3-9197-952547ec436e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:48.455511 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d5de61f-30eb-49c3-9197-952547ec436e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:48.456185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d5de61f-30eb-49c3-9197-952547ec436e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:48.461368 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d5de61f-30eb-49c3-9197-952547ec436e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:48.461368 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d5de61f-30eb-49c3-9197-952547ec436e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:48.482971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=100 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:48.555104 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4d5de61f-30eb-49c3-9197-952547ec436e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:48.564184 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4d5de61f-30eb-49c3-9197-952547ec436e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1293 microversion: 2.1 time: 0.123529 Jun 22 09:09:48.565168 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 159/329] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:48 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1293 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:49.235022 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c0c5d17f-8898-4c57-aaa2-6b9279177594 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:49.235637 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c0c5d17f-8898-4c57-aaa2-6b9279177594 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:49.242303 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c0c5d17f-8898-4c57-aaa2-6b9279177594 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:49.242847 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c0c5d17f-8898-4c57-aaa2-6b9279177594 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:49.243682 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c0c5d17f-8898-4c57-aaa2-6b9279177594 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:49.244213 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c0c5d17f-8898-4c57-aaa2-6b9279177594 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:49.388055 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c0c5d17f-8898-4c57-aaa2-6b9279177594 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:49.400103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c0c5d17f-8898-4c57-aaa2-6b9279177594 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.169637 Jun 22 09:09:49.400749 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 171/330] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:49 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:49.581741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-46fd67f1-e9a3-4dd1-8d37-80a5d703781c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:49.582351 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-46fd67f1-e9a3-4dd1-8d37-80a5d703781c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:49.589768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-46fd67f1-e9a3-4dd1-8d37-80a5d703781c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:49.590216 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-46fd67f1-e9a3-4dd1-8d37-80a5d703781c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:49.591542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-46fd67f1-e9a3-4dd1-8d37-80a5d703781c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:49.591977 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-46fd67f1-e9a3-4dd1-8d37-80a5d703781c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:49.662559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-46fd67f1-e9a3-4dd1-8d37-80a5d703781c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:49.672066 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-46fd67f1-e9a3-4dd1-8d37-80a5d703781c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1293 microversion: 2.1 time: 0.094247 Jun 22 09:09:49.678154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 160/331] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:49 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:50.423060 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d3f3ba1c-8e8b-45e4-9bd3-021e671f8248 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:50.424353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d3f3ba1c-8e8b-45e4-9bd3-021e671f8248 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:50.432305 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:50.442535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d3f3ba1c-8e8b-45e4-9bd3-021e671f8248 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:50.443289 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d3f3ba1c-8e8b-45e4-9bd3-021e671f8248 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:50.444267 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d3f3ba1c-8e8b-45e4-9bd3-021e671f8248 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:50.444935 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d3f3ba1c-8e8b-45e4-9bd3-021e671f8248 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:50.482920 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:50.625282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d3f3ba1c-8e8b-45e4-9bd3-021e671f8248 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:50.633365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d3f3ba1c-8e8b-45e4-9bd3-021e671f8248 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.220021 Jun 22 09:09:50.633946 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 172/332] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:50 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:50.690506 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-68ac7464-a516-44e6-98d3-03fc9ab22d0f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:50.691760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-68ac7464-a516-44e6-98d3-03fc9ab22d0f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:50.700714 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68ac7464-a516-44e6-98d3-03fc9ab22d0f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:50.701387 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68ac7464-a516-44e6-98d3-03fc9ab22d0f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:50.702678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68ac7464-a516-44e6-98d3-03fc9ab22d0f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:50.703498 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68ac7464-a516-44e6-98d3-03fc9ab22d0f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:50.795384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-68ac7464-a516-44e6-98d3-03fc9ab22d0f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:50.807209 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-68ac7464-a516-44e6-98d3-03fc9ab22d0f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1293 microversion: 2.1 time: 0.121135 Jun 22 09:09:50.808497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 161/333] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:50 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:51.656291 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a73c812a-6696-44c0-a12e-9483a32304be tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:51.657502 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a73c812a-6696-44c0-a12e-9483a32304be tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:51.665739 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a73c812a-6696-44c0-a12e-9483a32304be tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:51.666496 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a73c812a-6696-44c0-a12e-9483a32304be tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:51.667505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a73c812a-6696-44c0-a12e-9483a32304be tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:51.668129 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a73c812a-6696-44c0-a12e-9483a32304be tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:51.812454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a73c812a-6696-44c0-a12e-9483a32304be tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:51.820240 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a73c812a-6696-44c0-a12e-9483a32304be tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.172840 Jun 22 09:09:51.820739 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 173/334] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:51 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:51.824582 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4bc80c29-6fb8-4e50-b512-443e6facffae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:51.825232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4bc80c29-6fb8-4e50-b512-443e6facffae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:51.831879 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4bc80c29-6fb8-4e50-b512-443e6facffae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:51.832319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4bc80c29-6fb8-4e50-b512-443e6facffae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:51.833054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4bc80c29-6fb8-4e50-b512-443e6facffae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:51.833484 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4bc80c29-6fb8-4e50-b512-443e6facffae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:51.962872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4bc80c29-6fb8-4e50-b512-443e6facffae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:51.973198 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4bc80c29-6fb8-4e50-b512-443e6facffae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1311 microversion: 2.1 time: 0.152318 Jun 22 09:09:51.976472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 162/335] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:51 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:52.838354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d0847119-3b90-45d7-8f5b-b215ee34812f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:52.839793 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d0847119-3b90-45d7-8f5b-b215ee34812f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:52.847824 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d0847119-3b90-45d7-8f5b-b215ee34812f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:52.853818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d0847119-3b90-45d7-8f5b-b215ee34812f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:52.860454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d0847119-3b90-45d7-8f5b-b215ee34812f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:52.860454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d0847119-3b90-45d7-8f5b-b215ee34812f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:52.998331 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d004c996-4123-4b94-a59c-88c737da8a5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:53.000204 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d004c996-4123-4b94-a59c-88c737da8a5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:53.031667 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:53.033637 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=12 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:53.035363 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d004c996-4123-4b94-a59c-88c737da8a5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:53.035817 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d004c996-4123-4b94-a59c-88c737da8a5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:53.043364 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d004c996-4123-4b94-a59c-88c737da8a5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:53.048964 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d004c996-4123-4b94-a59c-88c737da8a5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:53.163161 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d0847119-3b90-45d7-8f5b-b215ee34812f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:53.166953 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d0847119-3b90-45d7-8f5b-b215ee34812f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1368 microversion: 2.1 time: 0.333284 Jun 22 09:09:53.167639 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 174/336] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:52 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:53.554748 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d004c996-4123-4b94-a59c-88c737da8a5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:53.565081 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d004c996-4123-4b94-a59c-88c737da8a5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.570923 Jun 22 09:09:53.574903 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 163/337] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:52 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:54.187140 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-462c6d39-44a1-41e9-a0a0-86efd18cc7a6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:54.187140 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-462c6d39-44a1-41e9-a0a0-86efd18cc7a6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:54.230462 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-462c6d39-44a1-41e9-a0a0-86efd18cc7a6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:54.231274 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-462c6d39-44a1-41e9-a0a0-86efd18cc7a6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:54.232232 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-462c6d39-44a1-41e9-a0a0-86efd18cc7a6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:54.234566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-462c6d39-44a1-41e9-a0a0-86efd18cc7a6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:54.426539 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-462c6d39-44a1-41e9-a0a0-86efd18cc7a6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:54.443816 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-462c6d39-44a1-41e9-a0a0-86efd18cc7a6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1561 microversion: 2.1 time: 0.260179 Jun 22 09:09:54.445499 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 175/338] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:54 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1561 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:54.466873 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-30720d04-0f2d-423b-8593-a545ca2248a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:54.467964 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-30720d04-0f2d-423b-8593-a545ca2248a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:54.480844 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-30720d04-0f2d-423b-8593-a545ca2248a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:54.489308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-30720d04-0f2d-423b-8593-a545ca2248a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:54.489308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-30720d04-0f2d-423b-8593-a545ca2248a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:54.489308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-30720d04-0f2d-423b-8593-a545ca2248a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:54.582874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cf13198c-6cc3-4c9a-a808-eb3b15d8ee6c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:54.583698 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cf13198c-6cc3-4c9a-a808-eb3b15d8ee6c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:54.591592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf13198c-6cc3-4c9a-a808-eb3b15d8ee6c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:54.592344 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf13198c-6cc3-4c9a-a808-eb3b15d8ee6c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:54.593599 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf13198c-6cc3-4c9a-a808-eb3b15d8ee6c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:54.594192 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf13198c-6cc3-4c9a-a808-eb3b15d8ee6c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:54.672967 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-30720d04-0f2d-423b-8593-a545ca2248a3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211101 Jun 22 09:09:54.674057 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 164/339] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 22 09:09:54 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:54.883195 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cf13198c-6cc3-4c9a-a808-eb3b15d8ee6c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:54.896334 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cf13198c-6cc3-4c9a-a808-eb3b15d8ee6c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.317865 Jun 22 09:09:54.899137 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 176/340] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:54 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:55.185189 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-cd353627-0c1c-4c7a-9c16-a791a671834a req-c0da5437-057e-4104-a9be-f3f1b34ff4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ec2434-e40b-47fc-b565-d465e3fe0f79", "tag": "ea94d4c1-1187-4b56-802a-ec257ccfe3bf"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:55.194108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-cd353627-0c1c-4c7a-9c16-a791a671834a req-c0da5437-057e-4104-a9be-f3f1b34ff4c3 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:55.202050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-cd353627-0c1c-4c7a-9c16-a791a671834a req-c0da5437-057e-4104-a9be-f3f1b34ff4c3 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:55.222044 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-cd353627-0c1c-4c7a-9c16-a791a671834a req-c0da5437-057e-4104-a9be-f3f1b34ff4c3 service nova] Creating event network-changed:ea94d4c1-1187-4b56-802a-ec257ccfe3bf for instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 on hv-cinder-80382 Jun 22 09:09:55.227980 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-cd353627-0c1c-4c7a-9c16-a791a671834a req-c0da5437-057e-4104-a9be-f3f1b34ff4c3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047459 Jun 22 09:09:55.229973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 165/341] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:55.913695 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f46c273c-fe6a-4be0-a429-075c9a8ad662 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:55.914978 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f46c273c-fe6a-4be0-a429-075c9a8ad662 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:55.923536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f46c273c-fe6a-4be0-a429-075c9a8ad662 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:55.924816 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f46c273c-fe6a-4be0-a429-075c9a8ad662 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:55.925786 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f46c273c-fe6a-4be0-a429-075c9a8ad662 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:55.926789 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f46c273c-fe6a-4be0-a429-075c9a8ad662 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:56.176938 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f46c273c-fe6a-4be0-a429-075c9a8ad662 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:56.185341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f46c273c-fe6a-4be0-a429-075c9a8ad662 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.274980 Jun 22 09:09:56.195122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 177/342] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:55 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:56.307530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-f6f63a19-58bd-4541-8668-6a9cc40a2b22 req-f377f557-600f-48be-abad-385beed0253c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e593a5f-2134-4ca1-95b8-5f2e454dca54", "tag": "c3ed1249-4d90-4b41-b5b8-c3d483a0e086"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:56.317102 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-f6f63a19-58bd-4541-8668-6a9cc40a2b22 req-f377f557-600f-48be-abad-385beed0253c service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:56.317827 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-f6f63a19-58bd-4541-8668-6a9cc40a2b22 req-f377f557-600f-48be-abad-385beed0253c service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:56.330758 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-f6f63a19-58bd-4541-8668-6a9cc40a2b22 req-f377f557-600f-48be-abad-385beed0253c service nova] Creating event network-changed:c3ed1249-4d90-4b41-b5b8-c3d483a0e086 for instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 on hv-cinder-80382 Jun 22 09:09:56.336190 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-f6f63a19-58bd-4541-8668-6a9cc40a2b22 req-f377f557-600f-48be-abad-385beed0253c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033146 Jun 22 09:09:56.337370 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 166/343] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:57.202263 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c7449c71-15df-46ac-827f-44dfc7ad9207 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:57.204964 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c7449c71-15df-46ac-827f-44dfc7ad9207 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:57.209662 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c7449c71-15df-46ac-827f-44dfc7ad9207 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:57.210110 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c7449c71-15df-46ac-827f-44dfc7ad9207 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:57.211011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c7449c71-15df-46ac-827f-44dfc7ad9207 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:57.211414 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c7449c71-15df-46ac-827f-44dfc7ad9207 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:57.403971 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c7449c71-15df-46ac-827f-44dfc7ad9207 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:57.413402 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c7449c71-15df-46ac-827f-44dfc7ad9207 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.215670 Jun 22 09:09:57.414052 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 178/344] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:57 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:57.723172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f09c3e97-045d-4daf-a9ca-dbd88e1beb19 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:57.724618 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f09c3e97-045d-4daf-a9ca-dbd88e1beb19 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:57.735836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f09c3e97-045d-4daf-a9ca-dbd88e1beb19 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:57.736301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f09c3e97-045d-4daf-a9ca-dbd88e1beb19 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:57.737233 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f09c3e97-045d-4daf-a9ca-dbd88e1beb19 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:57.737704 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f09c3e97-045d-4daf-a9ca-dbd88e1beb19 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:57.766159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f09c3e97-045d-4daf-a9ca-dbd88e1beb19 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/ips" status: 200 len: 152 microversion: 2.20 time: 0.048897 Jun 22 09:09:57.766916 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 167/345] 10.222.0.55 () {60 vars in 1288 bytes} [Wed Jun 22 09:09:57 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:09:58.433219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f658a5e9-2668-4d06-9816-d5b8ab1a4816 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:58.433842 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f658a5e9-2668-4d06-9816-d5b8ab1a4816 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:58.440972 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f658a5e9-2668-4d06-9816-d5b8ab1a4816 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:58.441568 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f658a5e9-2668-4d06-9816-d5b8ab1a4816 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:58.442355 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f658a5e9-2668-4d06-9816-d5b8ab1a4816 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:58.443215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f658a5e9-2668-4d06-9816-d5b8ab1a4816 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:58.617614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f658a5e9-2668-4d06-9816-d5b8ab1a4816 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:58.627758 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f658a5e9-2668-4d06-9816-d5b8ab1a4816 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.200315 Jun 22 09:09:58.628327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 179/346] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:58 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:59.414307 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0fbb0331-e680-439d-af5d-9d67b34c0256 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Action: 'create', calling method: .version_select at 0x7f500e64f3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1826857514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSXfyw17kxnXdw83uapfljRf8YisMGvYyOyGZzwENb6ChQb/TPRfwdOmkeKUk6kiPWeBbuFVBL2eq+W5lnUTX4BkpsUQIWSzPLQVIiWEojOhIeiVki6I/ydIKzujF5+5g=="}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:59.429249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-0fbb0331-e680-439d-af5d-9d67b34c0256 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Getting quotas for project ed7f3e35bb9a4f2ea707996c3c46acfb. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:59.436650 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-0fbb0331-e680-439d-af5d-9d67b34c0256 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Getting quotas for user a7bc17464f3346d0aba238a2dee0dc47 and project ed7f3e35bb9a4f2ea707996c3c46acfb. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:59.520557 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0fbb0331-e680-439d-af5d-9d67b34c0256 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.310480 Jun 22 09:09:59.521192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 168/347] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:09:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:59.644793 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bc0f2840-4e99-4960-88e0-0c2e772bf7ee tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:59.645437 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bc0f2840-4e99-4960-88e0-0c2e772bf7ee tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:59.654954 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc0f2840-4e99-4960-88e0-0c2e772bf7ee tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:59.655284 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc0f2840-4e99-4960-88e0-0c2e772bf7ee tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:59.656317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc0f2840-4e99-4960-88e0-0c2e772bf7ee tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:59.656668 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc0f2840-4e99-4960-88e0-0c2e772bf7ee tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:59.790068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bc0f2840-4e99-4960-88e0-0c2e772bf7ee tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:59.797831 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bc0f2840-4e99-4960-88e0-0c2e772bf7ee tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.157063 Jun 22 09:09:59.798535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 180/348] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:59 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:00.817441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bdbbd708-b8a4-4a6f-9002-7270375f8468 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:00.818274 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bdbbd708-b8a4-4a6f-9002-7270375f8468 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:00.827713 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bdbbd708-b8a4-4a6f-9002-7270375f8468 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:00.828444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bdbbd708-b8a4-4a6f-9002-7270375f8468 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:00.829438 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bdbbd708-b8a4-4a6f-9002-7270375f8468 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:00.830066 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bdbbd708-b8a4-4a6f-9002-7270375f8468 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:01.056709 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bdbbd708-b8a4-4a6f-9002-7270375f8468 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:01.066622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bdbbd708-b8a4-4a6f-9002-7270375f8468 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.255285 Jun 22 09:10:01.067827 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 169/349] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:00 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:02.090322 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c820dc3a-67ca-4a5f-84e2-2b338128f0a0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:02.091120 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c820dc3a-67ca-4a5f-84e2-2b338128f0a0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:02.102890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c820dc3a-67ca-4a5f-84e2-2b338128f0a0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:02.105538 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c820dc3a-67ca-4a5f-84e2-2b338128f0a0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:02.107418 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c820dc3a-67ca-4a5f-84e2-2b338128f0a0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:02.111127 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c820dc3a-67ca-4a5f-84e2-2b338128f0a0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:02.291107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c820dc3a-67ca-4a5f-84e2-2b338128f0a0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:02.303140 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c820dc3a-67ca-4a5f-84e2-2b338128f0a0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.221641 Jun 22 09:10:02.304225 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 181/350] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:02 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:03.192546 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-caebfe83-8aba-4097-a72d-d2386416bd2a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:03.193084 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-caebfe83-8aba-4097-a72d-d2386416bd2a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:03.200420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-caebfe83-8aba-4097-a72d-d2386416bd2a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:03.200870 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-caebfe83-8aba-4097-a72d-d2386416bd2a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:03.201643 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-caebfe83-8aba-4097-a72d-d2386416bd2a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:03.202080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-caebfe83-8aba-4097-a72d-d2386416bd2a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:03.226091 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-caebfe83-8aba-4097-a72d-d2386416bd2a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lazy-loading 'flavor' on Instance uuid 04c02245-d347-4fe2-8836-ca64aeb90e74 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:10:03.319871 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bffc4972-0121-42fb-80d5-c5e3c5975d6d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:03.320478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bffc4972-0121-42fb-80d5-c5e3c5975d6d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:03.327707 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bffc4972-0121-42fb-80d5-c5e3c5975d6d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:03.328213 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bffc4972-0121-42fb-80d5-c5e3c5975d6d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:03.329047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bffc4972-0121-42fb-80d5-c5e3c5975d6d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:03.329522 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bffc4972-0121-42fb-80d5-c5e3c5975d6d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:03.468018 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bffc4972-0121-42fb-80d5-c5e3c5975d6d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:03.475852 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bffc4972-0121-42fb-80d5-c5e3c5975d6d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.159802 Jun 22 09:10:03.476527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 182/351] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:03 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:04.050426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-caebfe83-8aba-4097-a72d-d2386416bd2a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/action" status: 202 len: 0 microversion: 2.20 time: 0.861785 Jun 22 09:10:04.051241 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 170/352] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 22 09:10:03 2022] POST /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/action => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:10:04.059288 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:04.059894 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:04.065903 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:04.066343 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:04.067135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:04.067570 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:04.196851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:04.204596 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:04.206104 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:04.207290 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2d855299-f8a6-4f57-b1e7-a540248d52f3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.151957 Jun 22 09:10:04.207836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 183/353] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:04 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:04.494840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-68381e3c-7d29-4059-ade7-154b6146355e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:04.495554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-68381e3c-7d29-4059-ade7-154b6146355e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:04.502553 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68381e3c-7d29-4059-ade7-154b6146355e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:04.508001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68381e3c-7d29-4059-ade7-154b6146355e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:04.508001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68381e3c-7d29-4059-ade7-154b6146355e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:04.508001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68381e3c-7d29-4059-ade7-154b6146355e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:04.643059 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-68381e3c-7d29-4059-ade7-154b6146355e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:04.650542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-68381e3c-7d29-4059-ade7-154b6146355e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.160583 Jun 22 09:10:04.653428 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 171/354] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:04 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:05.225871 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:05.226471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:05.233422 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:05.233873 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:05.234666 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:05.235168 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:05.403310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:05.412552 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:05.414161 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:05.415524 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1ea609de-64ff-45b2-97e2-5b4d3a11aeac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.193922 Jun 22 09:10:05.428559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 184/355] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:05 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:05.667070 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5a12dbf9-fa58-4083-984e-f3271a419498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:05.667681 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5a12dbf9-fa58-4083-984e-f3271a419498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:05.674445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5a12dbf9-fa58-4083-984e-f3271a419498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:05.674925 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5a12dbf9-fa58-4083-984e-f3271a419498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:05.675693 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5a12dbf9-fa58-4083-984e-f3271a419498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:05.676174 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5a12dbf9-fa58-4083-984e-f3271a419498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:05.806805 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5a12dbf9-fa58-4083-984e-f3271a419498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:05.816431 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5a12dbf9-fa58-4083-984e-f3271a419498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.153128 Jun 22 09:10:05.817211 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 172/356] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:05 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:06.434179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:06.434833 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:06.441255 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:06.441696 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:06.442439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:06.442886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:06.577698 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:06.586071 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:06.587646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:06.588891 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-53f0f578-bafb-4958-a967-8cb19630a978 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.159193 Jun 22 09:10:06.589443 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 185/357] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:06 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:06.833983 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-614cd864-930b-4bbc-bb52-b9bdfa247ad2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:06.834610 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-614cd864-930b-4bbc-bb52-b9bdfa247ad2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:06.841071 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-614cd864-930b-4bbc-bb52-b9bdfa247ad2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:06.841514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-614cd864-930b-4bbc-bb52-b9bdfa247ad2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:06.842267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-614cd864-930b-4bbc-bb52-b9bdfa247ad2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:06.842692 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-614cd864-930b-4bbc-bb52-b9bdfa247ad2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:06.975554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-614cd864-930b-4bbc-bb52-b9bdfa247ad2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:06.983878 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-614cd864-930b-4bbc-bb52-b9bdfa247ad2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.153811 Jun 22 09:10:06.984442 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 173/358] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:06 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:07.404009 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-5be3f677-6cec-42b1-8218-3ae111f16cb9 req-c5ead3b1-8b97-4f33-9f2a-f271f91af9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ec2434-e40b-47fc-b565-d465e3fe0f79", "name": "network-vif-plugged", "status": "completed", "tag": "ea94d4c1-1187-4b56-802a-ec257ccfe3bf"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:07.412690 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-5be3f677-6cec-42b1-8218-3ae111f16cb9 req-c5ead3b1-8b97-4f33-9f2a-f271f91af9f4 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:07.412797 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-5be3f677-6cec-42b1-8218-3ae111f16cb9 req-c5ead3b1-8b97-4f33-9f2a-f271f91af9f4 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:07.424447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-5be3f677-6cec-42b1-8218-3ae111f16cb9 req-c5ead3b1-8b97-4f33-9f2a-f271f91af9f4 service nova] Creating event network-vif-plugged:ea94d4c1-1187-4b56-802a-ec257ccfe3bf for instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 on hv-cinder-80382 Jun 22 09:10:07.431246 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-5be3f677-6cec-42b1-8218-3ae111f16cb9 req-c5ead3b1-8b97-4f33-9f2a-f271f91af9f4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030945 Jun 22 09:10:07.431891 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 186/359] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:10:07.607741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:07.608372 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:07.614405 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:07.616640 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:07.616640 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:07.616640 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:07.745262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:07.753954 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:07.755500 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:07.756764 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7a8bb54d-60e9-4327-9942-d634574469ed tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.153461 Jun 22 09:10:07.757513 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 174/360] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:07 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:08.001159 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0e8615f7-aac8-44ba-a04e-5f4eefc0f677 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:08.001787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0e8615f7-aac8-44ba-a04e-5f4eefc0f677 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:08.008080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0e8615f7-aac8-44ba-a04e-5f4eefc0f677 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:08.008527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0e8615f7-aac8-44ba-a04e-5f4eefc0f677 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:08.009280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0e8615f7-aac8-44ba-a04e-5f4eefc0f677 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:08.009706 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0e8615f7-aac8-44ba-a04e-5f4eefc0f677 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:08.138126 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0e8615f7-aac8-44ba-a04e-5f4eefc0f677 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:08.145393 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0e8615f7-aac8-44ba-a04e-5f4eefc0f677 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.149065 Jun 22 09:10:08.145956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 187/361] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:07 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:08.775833 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:08.776427 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:08.783535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:08.794442 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:08.794442 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:08.794442 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:08.913820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:08.921604 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:08.923131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:08.924274 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1c7260b3-b123-4dbe-a0f6-d51cfab1bdf2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.152458 Jun 22 09:10:08.924820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 175/362] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:08 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:09.162808 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-06176ea0-5ef5-4886-a7a0-df772413b886 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:09.163351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-06176ea0-5ef5-4886-a7a0-df772413b886 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:09.170489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-06176ea0-5ef5-4886-a7a0-df772413b886 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:09.170955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-06176ea0-5ef5-4886-a7a0-df772413b886 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:09.171709 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-06176ea0-5ef5-4886-a7a0-df772413b886 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:09.172141 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-06176ea0-5ef5-4886-a7a0-df772413b886 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:09.297085 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-06176ea0-5ef5-4886-a7a0-df772413b886 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:09.304455 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-06176ea0-5ef5-4886-a7a0-df772413b886 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1366 microversion: 2.1 time: 0.145615 Jun 22 09:10:09.307979 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 188/363] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:09 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:09.802751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-248e2ebe-399b-461c-9aa0-d1f6ad7a234a tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:09.803283 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-248e2ebe-399b-461c-9aa0-d1f6ad7a234a tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:09.805253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=4 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:09.811102 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-248e2ebe-399b-461c-9aa0-d1f6ad7a234a tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:09.811556 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-248e2ebe-399b-461c-9aa0-d1f6ad7a234a tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:09.812301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-248e2ebe-399b-461c-9aa0-d1f6ad7a234a tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:09.812736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-248e2ebe-399b-461c-9aa0-d1f6ad7a234a tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:09.937214 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:09.941132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-248e2ebe-399b-461c-9aa0-d1f6ad7a234a tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lazy-loading 'services' on Instance uuid 0e81493b-721d-4eff-a43f-85d2b26c3e25 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:10:09.941484 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:09.942086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:09.948067 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:09.948507 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:09.949255 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:09.949684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:09.970184 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:10.095047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:10.103114 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:10.104620 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:10.105834 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6ebac0d2-74c5-436e-bf8f-86ef8b30753e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.168261 Jun 22 09:10:10.108236 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 189/364] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:09 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:10.226598 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-248e2ebe-399b-461c-9aa0-d1f6ad7a234a tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25/os-volume_attachments/7c45fc8f-7e4d-431c-845d-6ce295b97d9b" status: 202 len: 0 microversion: 2.1 time: 0.427521 Jun 22 09:10:10.233707 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 176/365] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:10:09 2022] DELETE /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25/os-volume_attachments/7c45fc8f-7e4d-431c-845d-6ce295b97d9b => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:10:10.321480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ef46e554-1294-44d3-9405-93b34624fb5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:10.322004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ef46e554-1294-44d3-9405-93b34624fb5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:10.328964 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ef46e554-1294-44d3-9405-93b34624fb5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:10.329403 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ef46e554-1294-44d3-9405-93b34624fb5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:10.330150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ef46e554-1294-44d3-9405-93b34624fb5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:10.330612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ef46e554-1294-44d3-9405-93b34624fb5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:10.456593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ef46e554-1294-44d3-9405-93b34624fb5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:10.463992 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ef46e554-1294-44d3-9405-93b34624fb5f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1556 microversion: 2.1 time: 0.146448 Jun 22 09:10:10.464559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 190/366] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:10 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:10.481791 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ef89b77e-6f1d-4b7a-b122-32a8e0d9aa9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:10.482372 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ef89b77e-6f1d-4b7a-b122-32a8e0d9aa9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:10.488572 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef89b77e-6f1d-4b7a-b122-32a8e0d9aa9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:10.489024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef89b77e-6f1d-4b7a-b122-32a8e0d9aa9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:10.489773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef89b77e-6f1d-4b7a-b122-32a8e0d9aa9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:10.490203 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef89b77e-6f1d-4b7a-b122-32a8e0d9aa9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:10.585391 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ef89b77e-6f1d-4b7a-b122-32a8e0d9aa9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108615 Jun 22 09:10:10.585985 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 177/367] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 22 09:10:10 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:11.125354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:11.126446 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:11.132819 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:11.133361 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:11.134216 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:11.134748 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:11.266558 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:11.274542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:11.276156 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:11.277395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2ce41685-46c4-4792-9e57-e0906ad38d07 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.156504 Jun 22 09:10:11.288594 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 191/368] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:11 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:11.859876 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-44df8e0e-8ada-45f2-981b-e8bd0eff6da0 req-3d02b840-e20a-4c72-877c-7ebff415883f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ec2434-e40b-47fc-b565-d465e3fe0f79", "tag": "ea94d4c1-1187-4b56-802a-ec257ccfe3bf"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:11.868332 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-44df8e0e-8ada-45f2-981b-e8bd0eff6da0 req-3d02b840-e20a-4c72-877c-7ebff415883f service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:11.868847 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-44df8e0e-8ada-45f2-981b-e8bd0eff6da0 req-3d02b840-e20a-4c72-877c-7ebff415883f service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:11.880742 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-44df8e0e-8ada-45f2-981b-e8bd0eff6da0 req-3d02b840-e20a-4c72-877c-7ebff415883f service nova] Creating event network-changed:ea94d4c1-1187-4b56-802a-ec257ccfe3bf for instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 on hv-cinder-80382 Jun 22 09:10:11.885422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-44df8e0e-8ada-45f2-981b-e8bd0eff6da0 req-3d02b840-e20a-4c72-877c-7ebff415883f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030509 Jun 22 09:10:11.886010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 178/369] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:12.298927 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:12.307017 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:12.313405 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:12.313855 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:12.314680 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:12.315150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:12.435839 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-069cf793-3823-457d-8b2b-835cd6421b1e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:12.436957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-069cf793-3823-457d-8b2b-835cd6421b1e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:12.446484 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-069cf793-3823-457d-8b2b-835cd6421b1e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:12.447643 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-069cf793-3823-457d-8b2b-835cd6421b1e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:12.448676 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-069cf793-3823-457d-8b2b-835cd6421b1e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:12.449279 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-069cf793-3823-457d-8b2b-835cd6421b1e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:12.482652 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-069cf793-3823-457d-8b2b-835cd6421b1e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:10:12.498712 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:12.509917 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:12.512010 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:12.514160 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-67a7cef5-402c-46c4-80ce-a030169a93c2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.219252 Jun 22 09:10:12.525319 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 192/370] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:12 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:12.776069 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-069cf793-3823-457d-8b2b-835cd6421b1e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 204 len: 0 microversion: 2.1 time: 0.346204 Jun 22 09:10:12.776841 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 179/371] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:10:12 2022] DELETE /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:10:12.789746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7d56f7c0-f7db-4834-98eb-616c21c53304 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:12.790990 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7d56f7c0-f7db-4834-98eb-616c21c53304 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:12.800063 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7d56f7c0-f7db-4834-98eb-616c21c53304 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:12.800609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7d56f7c0-f7db-4834-98eb-616c21c53304 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:12.801406 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7d56f7c0-f7db-4834-98eb-616c21c53304 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:12.802165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7d56f7c0-f7db-4834-98eb-616c21c53304 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:12.935958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7d56f7c0-f7db-4834-98eb-616c21c53304 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:12.943516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7d56f7c0-f7db-4834-98eb-616c21c53304 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1514 microversion: 2.1 time: 0.160701 Jun 22 09:10:12.944092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 193/372] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:12 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:13.533132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:13.533819 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:13.536252 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:13.540932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:13.541373 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:13.542113 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:13.542537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:13.672362 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:13.680081 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:13.681600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:13.682733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b85a83b9-869d-42f9-84d6-c097043f55d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.154413 Jun 22 09:10:13.683305 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 180/373] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:13 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:13.962317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c39470ee-6cbc-434f-a91f-01e4db1fdfa5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:13.963053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c39470ee-6cbc-434f-a91f-01e4db1fdfa5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:13.971090 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c39470ee-6cbc-434f-a91f-01e4db1fdfa5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:13.971541 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c39470ee-6cbc-434f-a91f-01e4db1fdfa5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:13.972313 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c39470ee-6cbc-434f-a91f-01e4db1fdfa5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:13.972748 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c39470ee-6cbc-434f-a91f-01e4db1fdfa5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:14.100248 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c39470ee-6cbc-434f-a91f-01e4db1fdfa5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:14.107894 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c39470ee-6cbc-434f-a91f-01e4db1fdfa5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1514 microversion: 2.1 time: 0.150239 Jun 22 09:10:14.108460 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 194/374] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:13 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:14.701170 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:14.701765 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:14.708368 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:14.708812 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:14.709556 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:14.709984 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:14.841985 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:14.850013 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:14.851547 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:14.852697 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e7579363-c85f-4d9a-b269-a38b08010b11 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.155921 Jun 22 09:10:14.853256 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 181/375] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:14 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:15.126374 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-70035899-6fa7-4976-b30e-3b95d82bacdb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:15.127707 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-70035899-6fa7-4976-b30e-3b95d82bacdb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:15.134019 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70035899-6fa7-4976-b30e-3b95d82bacdb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:15.134466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70035899-6fa7-4976-b30e-3b95d82bacdb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:15.135281 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70035899-6fa7-4976-b30e-3b95d82bacdb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:15.135716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70035899-6fa7-4976-b30e-3b95d82bacdb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:15.264018 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-70035899-6fa7-4976-b30e-3b95d82bacdb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:15.271383 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-70035899-6fa7-4976-b30e-3b95d82bacdb tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1514 microversion: 2.1 time: 0.150301 Jun 22 09:10:15.271942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 195/376] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:15 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:15.871046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:15.871586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:15.879041 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:15.879554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:15.880257 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:15.883565 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:16.095759 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:16.104268 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:16.107856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:16.107856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0f4002ea-5769-4254-9ecd-bedc34ec853d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.241322 Jun 22 09:10:16.108129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 182/377] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:15 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:16.288391 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-19cf6475-c305-41d7-84cd-04ff83282383 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:16.289004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-19cf6475-c305-41d7-84cd-04ff83282383 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:16.295716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-19cf6475-c305-41d7-84cd-04ff83282383 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:16.296163 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-19cf6475-c305-41d7-84cd-04ff83282383 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:16.296920 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-19cf6475-c305-41d7-84cd-04ff83282383 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:16.297360 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-19cf6475-c305-41d7-84cd-04ff83282383 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:16.468839 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-c117f23b-d78e-4223-a10c-f788b5d31805 req-486dff96-6b94-484f-9351-7f773f5e9bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e81493b-721d-4eff-a43f-85d2b26c3e25", "name": "network-vif-deleted", "tag": "4aca7fad-7c3e-433c-a3a4-675450c7a2d2"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:16.471144 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-19cf6475-c305-41d7-84cd-04ff83282383 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:16.478137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c117f23b-d78e-4223-a10c-f788b5d31805 req-486dff96-6b94-484f-9351-7f773f5e9bd0 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:16.478568 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c117f23b-d78e-4223-a10c-f788b5d31805 req-486dff96-6b94-484f-9351-7f773f5e9bd0 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:16.479676 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-19cf6475-c305-41d7-84cd-04ff83282383 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1514 microversion: 2.1 time: 0.195169 Jun 22 09:10:16.480253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 196/378] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:16 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:16.489802 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-c117f23b-d78e-4223-a10c-f788b5d31805 req-486dff96-6b94-484f-9351-7f773f5e9bd0 service nova] Creating event network-vif-deleted:4aca7fad-7c3e-433c-a3a4-675450c7a2d2 for instance 0e81493b-721d-4eff-a43f-85d2b26c3e25 on hv-cinder-80382 Jun 22 09:10:16.494683 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-c117f23b-d78e-4223-a10c-f788b5d31805 req-486dff96-6b94-484f-9351-7f773f5e9bd0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Jun 22 09:10:16.495628 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 183/379] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:17.125601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:17.126206 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:17.133070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:17.133506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:17.134253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:17.134686 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:17.267516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:17.275244 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:17.276730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:17.278370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9a26d088-7e75-41b8-b5b7-39b2bcd0c695 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.156212 Jun 22 09:10:17.278932 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 197/380] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:17 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:17.502784 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:17.503507 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:17.510177 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:17.510625 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:17.511409 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:17.511840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:17.541313 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:17.541752 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:17.542193 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lazy-loading 'fault' on Instance uuid 0e81493b-721d-4eff-a43f-85d2b26c3e25 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:10:17.585812 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:17.593756 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-45c7dd56-a0f9-4c23-ad92-9d1a0b913e54 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 200 len: 1308 microversion: 2.1 time: 0.095149 Jun 22 09:10:17.594324 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 184/381] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:17 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:18.296399 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:18.297008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:18.303636 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:18.304086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:18.304843 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:18.305280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:18.435383 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:18.443708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:18.445233 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:18.446394 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6f4e50eb-3bfd-42bd-ba7c-6c0c6c63cd18 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.153959 Jun 22 09:10:18.447566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 198/382] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:18 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:18.617394 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:18.617952 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 0e81493b-721d-4eff-a43f-85d2b26c3e25] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:18.625167 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:18.625826 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:18.626213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:18.626645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:18.641303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] HTTP exception thrown: Instance 0e81493b-721d-4eff-a43f-85d2b26c3e25 could not be found. Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Request method failure captured: Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 HTTP/1.1 Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistv-ls92isicHLVacwXd2ScCwyK9y8OJflgN5zMh-23b2AW00M9IfeDhNN8LK87FFHcDUkB-8DyWXCHvLWQLKHP7qPk7VQpfgqkWh9_7ChC7KEE87qEbyIzeHDjbHrhC7m2-tCIiqv3v2a7kaWZ0B4aYZnqH4_hUGq06Gj9R2IK5zAo Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 05bd1375c6784f58a77c9b508ff282c9 Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-VolumesSnapshotTestJSON-948784587 Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:10:18.643050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/05bd1375c6784f58a77c9b508ff282c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_05bd1375c6784f58a77c9b508ff282c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/05bd1375c6784f58a77c9b508ff282c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/05bd1375c6784f58a77c9b508ff282c9"}]}] Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-VolumesSnapshotTestJSON-948784587 Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 05bd1375c6784f58a77c9b508ff282c9 Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-948784587 Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-VolumesSnapshotTestJSON-948784587-project Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 4468a51c478d4fd38f2bc3066dff63ff Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-VolumesSnapshotTestJSON-948784587-project Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 0e81493b-721d-4eff-a43f-85d2b26c3e25 could not be found. Jun 22 09:10:18.644497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '0e81493b-721d-4eff-a43f-85d2b26c3e25'} Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e81493b-721d-4eff-a43f-85d2b26c3e25 could not be found. Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:10:18.645616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e81493b-721d-4eff-a43f-85d2b26c3e25 could not be found. Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e81493b-721d-4eff-a43f-85d2b26c3e25 could not be found. Jun 22 09:10:18.647063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:10:18.648159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Returning 404 to user: Instance 0e81493b-721d-4eff-a43f-85d2b26c3e25 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:10:18.648159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-02577666-a56f-4470-b17d-d8fd2498974c tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25" status: 404 len: 111 microversion: 2.1 time: 0.031058 Jun 22 09:10:18.648159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 185/383] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:18 2022] GET /compute/v2.1/servers/0e81493b-721d-4eff-a43f-85d2b26c3e25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:10:19.464970 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:19.465570 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:19.472166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:19.472611 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:19.473366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:19.473795 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:19.602637 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:19.611126 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:19.612618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:19.613755 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c03d3a97-2000-4356-9daf-c3c8323f6d7e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.152811 Jun 22 09:10:19.614314 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 199/384] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:19 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:20.631370 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:20.631914 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:20.639055 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:20.639503 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:20.640310 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:20.640745 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:20.769988 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:20.778481 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:20.780011 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:20.781145 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b8093f9e-a919-4dda-a9c3-6819742032b8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.153975 Jun 22 09:10:20.781692 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 186/385] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:20 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:21.798634 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:21.799296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:21.801680 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=56 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:21.806350 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:21.806789 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:21.807561 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:21.807985 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:21.934205 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:21.942006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:21.943543 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:21.944733 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7b920f8c-3c46-4a91-b8bd-860aebe7e66d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.149960 Jun 22 09:10:21.945286 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 200/386] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:21 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:22.962616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:22.963271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:22.970339 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:22.970780 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:22.971660 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:22.972085 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:23.101805 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:23.110020 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:23.111606 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:23.112778 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cb000f2e-9d00-4f12-a3fd-1ff4c36d6a5a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.154170 Jun 22 09:10:23.113332 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 187/387] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:22 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:24.130741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:24.131378 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:24.138542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:24.139024 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:24.139791 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:24.140228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:24.274625 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:24.283101 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:24.284619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:24.285804 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-413a7f8d-d3f0-4cc2-8d00-7dbaec12df12 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.158972 Jun 22 09:10:24.286593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 201/388] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:24 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:25.303653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:25.304285 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:25.310844 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:25.311281 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:25.312022 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:25.312446 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:25.444986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:25.453272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:25.454766 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:25.456061 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b7cb196e-d973-4efa-b233-f5375e3d37b2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.156305 Jun 22 09:10:25.456621 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 188/389] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:25 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:26.475209 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:26.475870 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:26.482461 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:26.482949 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:26.483712 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:26.484150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:26.610695 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:26.619437 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:26.621641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:26.622809 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-27b6ae30-c9d2-4850-b293-c1e73182ae8d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.151980 Jun 22 09:10:26.623395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 202/390] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:26 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:27.641353 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:27.641947 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:27.648414 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:27.649043 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:27.649794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:27.650217 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:27.777432 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:27.785148 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:27.786641 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:27.787802 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fa6fd6e8-4820-4d32-bc99-60b8dbfc24c9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.150426 Jun 22 09:10:27.788353 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 189/391] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:27 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:28.805602 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:28.806171 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:28.812609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:28.813045 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:28.813790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:28.814217 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:28.944254 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:28.952605 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:28.954142 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:28.955322 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bd18f5d0-f95c-4816-9d3c-88c0dc5c12ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1744 microversion: 2.20 time: 0.153631 Jun 22 09:10:28.955874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 203/392] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:28 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:29.091806 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1322378538", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "networks": [{"uuid": "2f01d4cf-c4d9-425d-9769-cc3409305f79"}]}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:29.141905 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] validate_networks() for [('2f01d4cf-c4d9-425d-9769-cc3409305f79', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:10:29.479055 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:10:29.479474 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:10:29.479940 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:10:29.480353 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:10:29.480759 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:10:29.489724 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:29.493959 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:29.493959 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:29.493959 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:29.509840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Getting quotas for project 05bd1375c6784f58a77c9b508ff282c9. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:10:29.514845 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Getting quotas for user 4468a51c478d4fd38f2bc3066dff63ff and project 05bd1375c6784f58a77c9b508ff282c9. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:10:29.526052 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:10:29.528396 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:10:29.656280 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-282755eb-7f01-4a53-886d-5acc7f98b7e1 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568903 Jun 22 09:10:29.656857 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 190/393] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:10:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:10:29.666815 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ac2695c4-ac67-4d17-acb6-5180c7299585 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:29.667462 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ac2695c4-ac67-4d17-acb6-5180c7299585 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:29.722741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ac2695c4-ac67-4d17-acb6-5180c7299585 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:29.730544 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ac2695c4-ac67-4d17-acb6-5180c7299585 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1219 microversion: 2.1 time: 0.067485 Jun 22 09:10:29.731715 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 204/394] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:29 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:29.973414 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:29.974009 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:29.980327 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:29.980766 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:29.982546 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:29.982546 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:30.045145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-253899501", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1826857514", "security_groups": [{"name": "tempest-secgroup-smoke-1408999735"}], "networks": [{"uuid": "eadb524c-d462-48fa-babc-9c6bbef657b3"}], "block_device_mapping_v2": [{"uuid": "db705f6a-e030-430d-8e86-955ded2ec518", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:30.117129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:30.126147 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:30.128627 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:30.130860 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e5473eda-f63f-4f5f-8b98-b7b3a9ab8184 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1744 microversion: 2.20 time: 0.160825 Jun 22 09:10:30.131160 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 191/395] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:29 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:30.161443 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] validate_networks() for [('eadb524c-d462-48fa-babc-9c6bbef657b3', None, None, None, None, None)] {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:10:30.522995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:10:30.523414 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:10:30.523880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:10:30.524305 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:10:30.524800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:10:30.534083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:30.534516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:30.535332 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:30.535757 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:30.553586 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Getting quotas for project ed7f3e35bb9a4f2ea707996c3c46acfb. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:10:30.560358 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Getting quotas for user a7bc17464f3346d0aba238a2dee0dc47 and project ed7f3e35bb9a4f2ea707996c3c46acfb. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:10:30.616211 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:10:30.618322 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db705f6a-e030-430d-8e86-955ded2ec518',volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:10:30.749295 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-86e28b43-4868-4168-b3f3-b5f191f23698 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:30.749825 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-86e28b43-4868-4168-b3f3-b5f191f23698 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:30.756544 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-86e28b43-4868-4168-b3f3-b5f191f23698 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:30.756995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-86e28b43-4868-4168-b3f3-b5f191f23698 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:30.757765 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-86e28b43-4868-4168-b3f3-b5f191f23698 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:30.758202 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-86e28b43-4868-4168-b3f3-b5f191f23698 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:30.823333 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-86e28b43-4868-4168-b3f3-b5f191f23698 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:30.831527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-86e28b43-4868-4168-b3f3-b5f191f23698 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1223 microversion: 2.1 time: 0.086980 Jun 22 09:10:30.832096 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 192/396] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:30 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:31.086383 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1be1c1d2-995a-4315-997c-3bf26c9c04f3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.045556 Jun 22 09:10:31.089252 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 205/397] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:10:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 09:10:31.097563 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-60a488eb-a6bf-4c04-99b9-933170b6490a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:31.098178 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-60a488eb-a6bf-4c04-99b9-933170b6490a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:31.148574 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:31.149478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:31.154046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-60a488eb-a6bf-4c04-99b9-933170b6490a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:31.156017 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:31.156466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:31.157238 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:31.157665 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:31.162087 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-60a488eb-a6bf-4c04-99b9-933170b6490a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1088 microversion: 2.1 time: 0.068411 Jun 22 09:10:31.164085 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 193/398] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:31 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:31.296248 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:31.305098 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:31.306705 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:31.308041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-500b85a7-4804-47b4-88cb-0067eee33564 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1744 microversion: 2.20 time: 0.163540 Jun 22 09:10:31.308610 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 206/399] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:31 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:31.850574 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d38d873b-81c9-4dae-840f-5b27e0e70ddf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:31.850574 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d38d873b-81c9-4dae-840f-5b27e0e70ddf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:31.859690 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d38d873b-81c9-4dae-840f-5b27e0e70ddf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:31.861259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d38d873b-81c9-4dae-840f-5b27e0e70ddf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:31.862215 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d38d873b-81c9-4dae-840f-5b27e0e70ddf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:31.862845 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d38d873b-81c9-4dae-840f-5b27e0e70ddf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:31.944789 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d38d873b-81c9-4dae-840f-5b27e0e70ddf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:31.948546 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:31.953208 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d38d873b-81c9-4dae-840f-5b27e0e70ddf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1279 microversion: 2.1 time: 0.108791 Jun 22 09:10:31.953793 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 194/400] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:31 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:32.179840 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9209f084-ae6f-401f-ac5a-124ce114bb6f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:32.180446 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9209f084-ae6f-401f-ac5a-124ce114bb6f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:32.234227 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9209f084-ae6f-401f-ac5a-124ce114bb6f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:32.240994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9209f084-ae6f-401f-ac5a-124ce114bb6f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1088 microversion: 2.1 time: 0.065158 Jun 22 09:10:32.241560 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 207/401] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:32 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:32.327892 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:32.328505 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:32.335873 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:32.336322 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:32.337337 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:32.337769 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:32.566634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:32.573534 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:32.575649 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:32.576806 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bc2a0ceb-c899-4686-8839-4533e03b6b27 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1744 microversion: 2.20 time: 0.254004 Jun 22 09:10:32.577553 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 195/402] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:32 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1744 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:32.976330 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-00379374-2938-41c6-88f9-2b7c0cf10cd5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:32.977195 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-00379374-2938-41c6-88f9-2b7c0cf10cd5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:32.984130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-00379374-2938-41c6-88f9-2b7c0cf10cd5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:32.984682 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-00379374-2938-41c6-88f9-2b7c0cf10cd5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:32.985442 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-00379374-2938-41c6-88f9-2b7c0cf10cd5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:32.986092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-00379374-2938-41c6-88f9-2b7c0cf10cd5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.127053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-00379374-2938-41c6-88f9-2b7c0cf10cd5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:33.130433 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:33.134974 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-00379374-2938-41c6-88f9-2b7c0cf10cd5 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1319 microversion: 2.1 time: 0.164074 Jun 22 09:10:33.135633 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 208/403] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:32 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:33.257736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3a6cfddc-22c4-41b9-b4b7-d47048802f4d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:33.258456 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3a6cfddc-22c4-41b9-b4b7-d47048802f4d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:33.267795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3a6cfddc-22c4-41b9-b4b7-d47048802f4d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.274187 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3a6cfddc-22c4-41b9-b4b7-d47048802f4d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.275267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3a6cfddc-22c4-41b9-b4b7-d47048802f4d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.275873 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3a6cfddc-22c4-41b9-b4b7-d47048802f4d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.363405 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3a6cfddc-22c4-41b9-b4b7-d47048802f4d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:33.371335 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3a6cfddc-22c4-41b9-b4b7-d47048802f4d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1186 microversion: 2.1 time: 0.117352 Jun 22 09:10:33.374114 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 196/404] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:33 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1186 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:33.576086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-65815777-3ed4-4d24-8447-8b96e34de34a req-27ce4d88-bab9-4c84-b4b5-563629221565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c02245-d347-4fe2-8836-ca64aeb90e74", "name": "network-vif-plugged", "status": "completed", "tag": "5897603a-c758-4aef-b13d-a1bcac6199a0"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:33.585791 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-65815777-3ed4-4d24-8447-8b96e34de34a req-27ce4d88-bab9-4c84-b4b5-563629221565 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.586246 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-65815777-3ed4-4d24-8447-8b96e34de34a req-27ce4d88-bab9-4c84-b4b5-563629221565 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.597513 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:33.598333 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:33.603390 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-65815777-3ed4-4d24-8447-8b96e34de34a req-27ce4d88-bab9-4c84-b4b5-563629221565 service nova] Creating event network-vif-plugged:5897603a-c758-4aef-b13d-a1bcac6199a0 for instance 04c02245-d347-4fe2-8836-ca64aeb90e74 on hv-cinder-80382 Jun 22 09:10:33.607212 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-65815777-3ed4-4d24-8447-8b96e34de34a req-27ce4d88-bab9-4c84-b4b5-563629221565 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034703 Jun 22 09:10:33.608327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 209/405] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:33.616163 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.616795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.617756 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.618603 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.755057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-1b621ebf-0261-415d-a181-3e03c4911dcf req-48626861-bd75-4d7b-a5ac-c941e06c193f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9ac4e6-8316-4cc4-b764-ee64344dffe0", "tag": "41924fe0-4d4e-4cee-b82a-b4bc77edf045"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:33.769113 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-1b621ebf-0261-415d-a181-3e03c4911dcf req-48626861-bd75-4d7b-a5ac-c941e06c193f service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:33.769853 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-1b621ebf-0261-415d-a181-3e03c4911dcf req-48626861-bd75-4d7b-a5ac-c941e06c193f service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:33.781978 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-1b621ebf-0261-415d-a181-3e03c4911dcf req-48626861-bd75-4d7b-a5ac-c941e06c193f service nova] Creating event network-changed:41924fe0-4d4e-4cee-b82a-b4bc77edf045 for instance 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 on hv-cinder-80382 Jun 22 09:10:33.790036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-1b621ebf-0261-415d-a181-3e03c4911dcf req-48626861-bd75-4d7b-a5ac-c941e06c193f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039027 Jun 22 09:10:33.790913 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 210/406] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:10:34.124180 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:34.134441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:34.136272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:34.138242 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-356d3daf-c6aa-4279-9519-732cd2b3ea7b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.546146 Jun 22 09:10:34.141996 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 197/407] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:33 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:34.163572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4b60be77-f5c3-4033-b6fc-d1eaa7246add tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:34.165282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4b60be77-f5c3-4033-b6fc-d1eaa7246add tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:34.173642 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4b60be77-f5c3-4033-b6fc-d1eaa7246add tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:34.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4b60be77-f5c3-4033-b6fc-d1eaa7246add tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:34.175919 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4b60be77-f5c3-4033-b6fc-d1eaa7246add tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:34.177671 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4b60be77-f5c3-4033-b6fc-d1eaa7246add tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:34.360282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4b60be77-f5c3-4033-b6fc-d1eaa7246add tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:34.373103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4b60be77-f5c3-4033-b6fc-d1eaa7246add tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1319 microversion: 2.1 time: 0.217346 Jun 22 09:10:34.373854 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 211/408] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:34 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:34.394495 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-73efc8d2-b398-48e5-9852-423c9717cf55 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:34.395974 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-73efc8d2-b398-48e5-9852-423c9717cf55 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:34.408080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73efc8d2-b398-48e5-9852-423c9717cf55 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:34.408910 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73efc8d2-b398-48e5-9852-423c9717cf55 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:34.410188 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73efc8d2-b398-48e5-9852-423c9717cf55 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:34.410997 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73efc8d2-b398-48e5-9852-423c9717cf55 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:34.523024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-73efc8d2-b398-48e5-9852-423c9717cf55 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:34.539200 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-73efc8d2-b398-48e5-9852-423c9717cf55 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1204 microversion: 2.1 time: 0.154775 Jun 22 09:10:34.539995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 198/409] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:34 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1204 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:35.159735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:35.160791 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:35.181598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:35.188315 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:35.189707 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:35.192976 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:35.395594 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0ce8a542-459e-4371-9a9f-3aba29f58ab4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:35.397035 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0ce8a542-459e-4371-9a9f-3aba29f58ab4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:35.417018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0ce8a542-459e-4371-9a9f-3aba29f58ab4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:35.417681 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0ce8a542-459e-4371-9a9f-3aba29f58ab4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:35.421205 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0ce8a542-459e-4371-9a9f-3aba29f58ab4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:35.421956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0ce8a542-459e-4371-9a9f-3aba29f58ab4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:35.491878 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:35.502348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:35.504655 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:35.506261 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-810239cd-cef2-4dfc-8888-4293b8de8545 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.350876 Jun 22 09:10:35.515651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 212/410] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:35 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:35.558143 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8515f669-7586-4592-ba87-95f3fdd0072b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:35.564210 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8515f669-7586-4592-ba87-95f3fdd0072b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:35.569659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8515f669-7586-4592-ba87-95f3fdd0072b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:35.570186 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8515f669-7586-4592-ba87-95f3fdd0072b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:35.571283 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8515f669-7586-4592-ba87-95f3fdd0072b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:35.571674 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8515f669-7586-4592-ba87-95f3fdd0072b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:35.654008 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-0ce8a542-459e-4371-9a9f-3aba29f58ab4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:35.665268 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0ce8a542-459e-4371-9a9f-3aba29f58ab4 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1319 microversion: 2.1 time: 0.276951 Jun 22 09:10:35.665849 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 199/411] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:35 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:35.755641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8515f669-7586-4592-ba87-95f3fdd0072b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:35.763668 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8515f669-7586-4592-ba87-95f3fdd0072b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1272 microversion: 2.1 time: 0.210573 Jun 22 09:10:35.764441 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 213/412] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:35 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:36.525938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:36.526607 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:36.534144 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:36.539677 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:36.539677 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:36.539677 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:36.682353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0f96dd89-7108-4534-add5-1ccd61e44db9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:36.683406 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0f96dd89-7108-4534-add5-1ccd61e44db9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:36.692473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0f96dd89-7108-4534-add5-1ccd61e44db9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:36.693541 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0f96dd89-7108-4534-add5-1ccd61e44db9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:36.695047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0f96dd89-7108-4534-add5-1ccd61e44db9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:36.695865 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0f96dd89-7108-4534-add5-1ccd61e44db9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:36.919304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0f96dd89-7108-4534-add5-1ccd61e44db9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:36.934483 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0f96dd89-7108-4534-add5-1ccd61e44db9 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1319 microversion: 2.1 time: 0.255341 Jun 22 09:10:36.935396 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 214/413] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:36 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:36.948585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-326b3f08-df2e-4b18-96f9-cd7cd5abfebd tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:36.949332 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-326b3f08-df2e-4b18-96f9-cd7cd5abfebd tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:36.957915 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-326b3f08-df2e-4b18-96f9-cd7cd5abfebd tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:36.958456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-326b3f08-df2e-4b18-96f9-cd7cd5abfebd tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:36.959343 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-326b3f08-df2e-4b18-96f9-cd7cd5abfebd tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:36.959859 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-326b3f08-df2e-4b18-96f9-cd7cd5abfebd tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:36.999331 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:37.012230 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:37.014657 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:37.016760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-36bf58fe-43a6-4a44-9dc0-655063ca4377 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.495003 Jun 22 09:10:37.027542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 200/414] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:36 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:37.139429 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-326b3f08-df2e-4b18-96f9-cd7cd5abfebd tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:37.152316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-326b3f08-df2e-4b18-96f9-cd7cd5abfebd tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.215758 Jun 22 09:10:37.153386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 215/415] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:36 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:37.659579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-c3ded54f-8a63-43e9-985e-84539aad5d39 req-6af92e70-b74a-4b63-aee2-aeff9f30394b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8edf80c-1741-417f-ad42-4cdf4567898f", "tag": "779d4f23-aa71-4166-aead-3f25b367efc9"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:37.670287 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c3ded54f-8a63-43e9-985e-84539aad5d39 req-6af92e70-b74a-4b63-aee2-aeff9f30394b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:37.671035 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c3ded54f-8a63-43e9-985e-84539aad5d39 req-6af92e70-b74a-4b63-aee2-aeff9f30394b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:37.689715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-c3ded54f-8a63-43e9-985e-84539aad5d39 req-6af92e70-b74a-4b63-aee2-aeff9f30394b service nova] Creating event network-changed:779d4f23-aa71-4166-aead-3f25b367efc9 for instance a8edf80c-1741-417f-ad42-4cdf4567898f on hv-cinder-80382 Jun 22 09:10:37.695420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-c3ded54f-8a63-43e9-985e-84539aad5d39 req-6af92e70-b74a-4b63-aee2-aeff9f30394b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047223 Jun 22 09:10:37.699341 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 201/416] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:37.957153 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a299ba49-e622-4f15-b0ae-532c88f4ade6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:37.958397 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a299ba49-e622-4f15-b0ae-532c88f4ade6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:37.966457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a299ba49-e622-4f15-b0ae-532c88f4ade6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:37.970042 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a299ba49-e622-4f15-b0ae-532c88f4ade6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:37.972020 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a299ba49-e622-4f15-b0ae-532c88f4ade6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:37.972974 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a299ba49-e622-4f15-b0ae-532c88f4ade6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:38.039610 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:38.040704 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:38.050938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:38.051741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:38.052742 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:38.053632 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:38.182206 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a299ba49-e622-4f15-b0ae-532c88f4ade6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:38.210011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a299ba49-e622-4f15-b0ae-532c88f4ade6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1319 microversion: 2.1 time: 0.261975 Jun 22 09:10:38.217591 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 216/417] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:37 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:38.231785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e38a5a7f-5d8f-4e9c-a513-a05c65f0388d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:38.232677 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e38a5a7f-5d8f-4e9c-a513-a05c65f0388d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:38.242103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:38.245208 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e38a5a7f-5d8f-4e9c-a513-a05c65f0388d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:38.245858 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e38a5a7f-5d8f-4e9c-a513-a05c65f0388d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:38.247188 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e38a5a7f-5d8f-4e9c-a513-a05c65f0388d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:38.247807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e38a5a7f-5d8f-4e9c-a513-a05c65f0388d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:38.255498 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:38.258187 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:38.260220 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-73aa8d1d-005d-4bab-8006-f57bffff5a68 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.227158 Jun 22 09:10:38.277580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 202/418] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:38 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:38.436552 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e38a5a7f-5d8f-4e9c-a513-a05c65f0388d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:38.446787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e38a5a7f-5d8f-4e9c-a513-a05c65f0388d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.221670 Jun 22 09:10:38.447819 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 217/419] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:38 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:39.233560 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a8f7cc5f-ba7a-4fe4-9c6e-b2e8f3a6ef69 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:39.234457 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a8f7cc5f-ba7a-4fe4-9c6e-b2e8f3a6ef69 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:39.243954 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a8f7cc5f-ba7a-4fe4-9c6e-b2e8f3a6ef69 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:39.245027 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a8f7cc5f-ba7a-4fe4-9c6e-b2e8f3a6ef69 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:39.245968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a8f7cc5f-ba7a-4fe4-9c6e-b2e8f3a6ef69 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:39.246935 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a8f7cc5f-ba7a-4fe4-9c6e-b2e8f3a6ef69 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:39.286204 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:39.292943 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:39.300433 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:39.301257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:39.302260 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:39.303346 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:39.480494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a8f7cc5f-ba7a-4fe4-9c6e-b2e8f3a6ef69 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:39.495390 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a8f7cc5f-ba7a-4fe4-9c6e-b2e8f3a6ef69 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1319 microversion: 2.1 time: 0.265557 Jun 22 09:10:39.496440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 203/420] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:39 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:39.502530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b662371f-54a8-4708-a28b-130730b7e75b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:39.503514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b662371f-54a8-4708-a28b-130730b7e75b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:39.522430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:39.526092 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b662371f-54a8-4708-a28b-130730b7e75b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:39.526092 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b662371f-54a8-4708-a28b-130730b7e75b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:39.527029 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b662371f-54a8-4708-a28b-130730b7e75b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:39.527715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b662371f-54a8-4708-a28b-130730b7e75b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:39.552067 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:39.575227 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:39.576777 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:39.577987 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8f36da8a-f3b6-45b4-8346-ad077795a573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.302960 Jun 22 09:10:39.591897 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 218/421] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:39 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:39.688067 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-f6d2e84f-2f63-4a0e-a82f-5fbccc8581bc req-ddc9f472-584f-4135-832f-2a2dca8b9c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9ac4e6-8316-4cc4-b764-ee64344dffe0", "name": "network-vif-plugged", "status": "completed", "tag": "41924fe0-4d4e-4cee-b82a-b4bc77edf045"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:39.697201 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-f6d2e84f-2f63-4a0e-a82f-5fbccc8581bc req-ddc9f472-584f-4135-832f-2a2dca8b9c4b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:39.697729 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-f6d2e84f-2f63-4a0e-a82f-5fbccc8581bc req-ddc9f472-584f-4135-832f-2a2dca8b9c4b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:39.708612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-f6d2e84f-2f63-4a0e-a82f-5fbccc8581bc req-ddc9f472-584f-4135-832f-2a2dca8b9c4b service nova] Creating event network-vif-plugged:41924fe0-4d4e-4cee-b82a-b4bc77edf045 for instance 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 on hv-cinder-80382 Jun 22 09:10:39.713906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-f6d2e84f-2f63-4a0e-a82f-5fbccc8581bc req-ddc9f472-584f-4135-832f-2a2dca8b9c4b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030414 Jun 22 09:10:39.714682 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b662371f-54a8-4708-a28b-130730b7e75b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:39.714857 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 219/422] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:10:39.725827 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b662371f-54a8-4708-a28b-130730b7e75b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.227017 Jun 22 09:10:39.726443 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 204/423] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:39 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:40.514041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0e02e6d3-f1a9-44f5-913d-1a3af692bdc3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:40.515478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0e02e6d3-f1a9-44f5-913d-1a3af692bdc3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:40.521992 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0e02e6d3-f1a9-44f5-913d-1a3af692bdc3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:40.522439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0e02e6d3-f1a9-44f5-913d-1a3af692bdc3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:40.523224 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0e02e6d3-f1a9-44f5-913d-1a3af692bdc3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:40.524027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0e02e6d3-f1a9-44f5-913d-1a3af692bdc3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:40.543107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:40.598727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:40.600473 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:40.609376 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:40.610207 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:40.611227 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:40.611877 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:40.695169 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0e02e6d3-f1a9-44f5-913d-1a3af692bdc3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:40.703769 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0e02e6d3-f1a9-44f5-913d-1a3af692bdc3 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1319 microversion: 2.1 time: 0.194999 Jun 22 09:10:40.705534 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 220/424] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:40 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:40.780766 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-22b99927-8028-4d40-89a9-90a913ea5ec2 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:40.781506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-22b99927-8028-4d40-89a9-90a913ea5ec2 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:40.791166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-22b99927-8028-4d40-89a9-90a913ea5ec2 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:40.791614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-22b99927-8028-4d40-89a9-90a913ea5ec2 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:40.792413 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-22b99927-8028-4d40-89a9-90a913ea5ec2 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:40.793071 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-22b99927-8028-4d40-89a9-90a913ea5ec2 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:40.816514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:40.825371 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:40.826901 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:40.828312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9a69ff01-17f8-4292-a6f9-fad878a40750 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.233482 Jun 22 09:10:40.839059 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 205/425] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:40 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:40.947116 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-22b99927-8028-4d40-89a9-90a913ea5ec2 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:40.956822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-22b99927-8028-4d40-89a9-90a913ea5ec2 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.179873 Jun 22 09:10:40.957491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 221/426] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:40 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:41.720992 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6b871c83-bd8e-47f4-9e81-07e26f358e7e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:41.722539 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6b871c83-bd8e-47f4-9e81-07e26f358e7e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:41.728727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=8 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:41.731938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b871c83-bd8e-47f4-9e81-07e26f358e7e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:41.732653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b871c83-bd8e-47f4-9e81-07e26f358e7e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:41.733485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b871c83-bd8e-47f4-9e81-07e26f358e7e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:41.733984 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b871c83-bd8e-47f4-9e81-07e26f358e7e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:41.846742 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:41.847304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:41.853931 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:41.854872 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:41.855166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:41.855604 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:41.897338 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-6b871c83-bd8e-47f4-9e81-07e26f358e7e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:41.905611 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6b871c83-bd8e-47f4-9e81-07e26f358e7e tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1319 microversion: 2.1 time: 0.188318 Jun 22 09:10:41.906580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 206/427] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:41 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:41.975617 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-084c4f8e-921f-4f18-a8f7-50472353f49e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:41.976301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-084c4f8e-921f-4f18-a8f7-50472353f49e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:41.984226 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-084c4f8e-921f-4f18-a8f7-50472353f49e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:41.984808 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-084c4f8e-921f-4f18-a8f7-50472353f49e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:41.985715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-084c4f8e-921f-4f18-a8f7-50472353f49e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:41.986242 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-084c4f8e-921f-4f18-a8f7-50472353f49e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:42.033014 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:42.047392 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:42.049371 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:42.050769 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4c3d7786-2280-4816-8f41-5d61aed6b7d4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.208017 Jun 22 09:10:42.051869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 222/428] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:41 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:42.138653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-084c4f8e-921f-4f18-a8f7-50472353f49e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:42.147878 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-084c4f8e-921f-4f18-a8f7-50472353f49e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.176119 Jun 22 09:10:42.157192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 207/429] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:41 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:42.924568 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5b2e8a71-3099-41ec-8bde-497ac6dd2aba tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:42.925310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5b2e8a71-3099-41ec-8bde-497ac6dd2aba tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:42.927243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=10 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:42.932700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b2e8a71-3099-41ec-8bde-497ac6dd2aba tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:42.933149 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b2e8a71-3099-41ec-8bde-497ac6dd2aba tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:42.934449 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b2e8a71-3099-41ec-8bde-497ac6dd2aba tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:42.934929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b2e8a71-3099-41ec-8bde-497ac6dd2aba tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:43.070642 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:43.072043 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:43.080446 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:43.080895 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:43.081659 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:43.082098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:43.085536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5b2e8a71-3099-41ec-8bde-497ac6dd2aba tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:43.093475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5b2e8a71-3099-41ec-8bde-497ac6dd2aba tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1508 microversion: 2.1 time: 0.173140 Jun 22 09:10:43.094081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 223/430] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:42 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:43.110198 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-70d81bb3-da7d-461e-80f6-de206ae7b549 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "235eca61-c063-40c9-a336-22a4e983595c", "device": "/dev/sdb"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:43.120413 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-70d81bb3-da7d-461e-80f6-de206ae7b549 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:43.120413 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70d81bb3-da7d-461e-80f6-de206ae7b549 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:43.120413 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70d81bb3-da7d-461e-80f6-de206ae7b549 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:43.120413 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70d81bb3-da7d-461e-80f6-de206ae7b549 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:43.120800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70d81bb3-da7d-461e-80f6-de206ae7b549 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:43.211932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:43.219957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:43.221458 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:43.222605 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ee5a6645-1f86-4b17-9705-1ed191e8333f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.156389 Jun 22 09:10:43.223203 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 208/431] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:43 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:43.227799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8f89eeff-955c-46c4-9703-65dac2c899d3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:43.228401 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8f89eeff-955c-46c4-9703-65dac2c899d3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:43.234542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8f89eeff-955c-46c4-9703-65dac2c899d3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:43.235041 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8f89eeff-955c-46c4-9703-65dac2c899d3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:43.235826 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8f89eeff-955c-46c4-9703-65dac2c899d3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:43.236259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8f89eeff-955c-46c4-9703-65dac2c899d3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:43.378311 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8f89eeff-955c-46c4-9703-65dac2c899d3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:43.386262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8f89eeff-955c-46c4-9703-65dac2c899d3 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.162082 Jun 22 09:10:43.390966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 209/432] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:43 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:43.939892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-70d81bb3-da7d-461e-80f6-de206ae7b549 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "POST /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833793 Jun 22 09:10:43.945581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 224/433] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:10:43 2022] POST /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0/os-volume_attachments => generated 194 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:10:44.241007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:44.241599 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:44.243926 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:44.249099 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:44.249539 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:44.250283 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:44.250710 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:44.385252 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:44.394773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:44.396390 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:44.399297 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2c6b8b28-a464-4b75-a6f5-caf715d3b46f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.162117 Jun 22 09:10:44.409696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 210/434] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:44 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:44.410149 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8b452cda-262b-4a43-a639-c8b65fa794a8 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:44.410149 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8b452cda-262b-4a43-a639-c8b65fa794a8 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:44.413663 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8b452cda-262b-4a43-a639-c8b65fa794a8 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:44.415822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8b452cda-262b-4a43-a639-c8b65fa794a8 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:44.415822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8b452cda-262b-4a43-a639-c8b65fa794a8 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:44.415822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8b452cda-262b-4a43-a639-c8b65fa794a8 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:44.549086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8b452cda-262b-4a43-a639-c8b65fa794a8 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:44.556471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8b452cda-262b-4a43-a639-c8b65fa794a8 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.156759 Jun 22 09:10:44.557038 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 225/435] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:44 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:44.590726 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0c972adb-e966-4948-9a57-99f1532a89ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:44.591241 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0c972adb-e966-4948-9a57-99f1532a89ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:44.597234 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0c972adb-e966-4948-9a57-99f1532a89ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:44.597677 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0c972adb-e966-4948-9a57-99f1532a89ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:44.598430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0c972adb-e966-4948-9a57-99f1532a89ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:44.598887 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0c972adb-e966-4948-9a57-99f1532a89ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:44.679441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-0c972adb-e966-4948-9a57-99f1532a89ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lazy-loading 'services' on Instance uuid 7a986f8d-3000-440e-b006-4c90b7c765fa {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:10:44.684852 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=100 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:44.893944 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0c972adb-e966-4948-9a57-99f1532a89ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/os-volume_attachments/82363130-40c5-4180-922f-dce9340d8373" status: 202 len: 0 microversion: 2.1 time: 0.307009 Jun 22 09:10:44.894525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 211/436] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:10:44 2022] DELETE /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/os-volume_attachments/82363130-40c5-4180-922f-dce9340d8373 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:10:45.416476 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:45.417077 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:45.423161 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:45.423602 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:45.424358 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:45.424782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:45.428807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:45.553038 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:45.561235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:45.568432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:45.568432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f4fce16a-86ef-49e0-b869-7b563cbf0495 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1739 microversion: 2.20 time: 0.151394 Jun 22 09:10:45.568432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 226/437] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:45 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:45.574972 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d98e001f-f1bc-4302-8fda-a5cfe6d1e934 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:45.575691 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d98e001f-f1bc-4302-8fda-a5cfe6d1e934 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:45.582100 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d98e001f-f1bc-4302-8fda-a5cfe6d1e934 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:45.582491 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d98e001f-f1bc-4302-8fda-a5cfe6d1e934 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:45.583280 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d98e001f-f1bc-4302-8fda-a5cfe6d1e934 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:45.583718 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d98e001f-f1bc-4302-8fda-a5cfe6d1e934 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:45.718763 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d98e001f-f1bc-4302-8fda-a5cfe6d1e934 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:45.726746 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d98e001f-f1bc-4302-8fda-a5cfe6d1e934 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.157027 Jun 22 09:10:45.727389 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 212/438] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:45 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:46.582863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:46.583505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:46.590602 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:46.591080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:46.591825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:46.592249 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:46.726529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:46.734997 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:46.736538 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:46.737711 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2045b133-7e23-46ee-9abe-3751ab426b35 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1721 microversion: 2.20 time: 0.158785 Jun 22 09:10:46.738263 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 227/439] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:46 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:46.743740 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5ccad3a6-4c0b-4205-aa32-abd04de2a93b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:46.744347 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5ccad3a6-4c0b-4205-aa32-abd04de2a93b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:46.750932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5ccad3a6-4c0b-4205-aa32-abd04de2a93b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:46.751370 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5ccad3a6-4c0b-4205-aa32-abd04de2a93b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:46.752108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5ccad3a6-4c0b-4205-aa32-abd04de2a93b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:46.752531 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5ccad3a6-4c0b-4205-aa32-abd04de2a93b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:46.884146 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5ccad3a6-4c0b-4205-aa32-abd04de2a93b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:46.892145 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5ccad3a6-4c0b-4205-aa32-abd04de2a93b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.152258 Jun 22 09:10:46.892741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 213/440] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:46 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:47.755849 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:47.756538 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:47.763044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:47.763491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:47.764296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:47.764728 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:47.891793 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:47.899599 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:47.901135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:47.902286 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f95ba92e-f3af-4010-a076-22e761c15d92 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1721 microversion: 2.20 time: 0.150335 Jun 22 09:10:47.903020 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 228/441] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:47 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:47.907762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-03455857-becf-4989-a80d-973a92b9472a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:47.908363 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-03455857-becf-4989-a80d-973a92b9472a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:47.914688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03455857-becf-4989-a80d-973a92b9472a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:47.915168 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03455857-becf-4989-a80d-973a92b9472a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:47.915983 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03455857-becf-4989-a80d-973a92b9472a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:47.916357 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03455857-becf-4989-a80d-973a92b9472a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:48.042843 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-03455857-becf-4989-a80d-973a92b9472a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:48.050848 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-03455857-becf-4989-a80d-973a92b9472a tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.146910 Jun 22 09:10:48.051421 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 214/442] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:47 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:48.920097 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:48.920638 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:48.927035 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:48.927471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:48.928212 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:48.928634 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:49.053080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:49.061543 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:49.063257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:49.064418 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-631c2b7f-b6f0-4637-b4be-ac7b71f617de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1724 microversion: 2.20 time: 0.148304 Jun 22 09:10:49.064975 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 229/443] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:48 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:49.067111 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-03a29f37-0354-43fc-aed7-4445898a7047 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:49.067751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-03a29f37-0354-43fc-aed7-4445898a7047 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:49.074128 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03a29f37-0354-43fc-aed7-4445898a7047 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:49.075215 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03a29f37-0354-43fc-aed7-4445898a7047 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:49.075971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03a29f37-0354-43fc-aed7-4445898a7047 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:49.076397 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03a29f37-0354-43fc-aed7-4445898a7047 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:49.082165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0d3be5fe-aa8b-4bcd-9ab1-7a548575b149 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96848c79-acfd-4160-bf0b-825ea5adc91b"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:49.083301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0d3be5fe-aa8b-4bcd-9ab1-7a548575b149 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:49.089163 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d3be5fe-aa8b-4bcd-9ab1-7a548575b149 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:49.089611 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d3be5fe-aa8b-4bcd-9ab1-7a548575b149 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:49.090371 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d3be5fe-aa8b-4bcd-9ab1-7a548575b149 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:49.090805 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d3be5fe-aa8b-4bcd-9ab1-7a548575b149 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:49.213734 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-03a29f37-0354-43fc-aed7-4445898a7047 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:49.221258 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-03a29f37-0354-43fc-aed7-4445898a7047 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.157933 Jun 22 09:10:49.221824 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 215/444] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:49 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:49.611336 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-26490539-8e70-4a53-88c3-f6132ed69865 req-bc9b05cb-ed43-479f-8945-53482eca5cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8edf80c-1741-417f-ad42-4cdf4567898f", "name": "network-vif-plugged", "status": "completed", "tag": "779d4f23-aa71-4166-aead-3f25b367efc9"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:49.619328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-26490539-8e70-4a53-88c3-f6132ed69865 req-bc9b05cb-ed43-479f-8945-53482eca5cd3 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:49.619767 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-26490539-8e70-4a53-88c3-f6132ed69865 req-bc9b05cb-ed43-479f-8945-53482eca5cd3 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:49.630577 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-26490539-8e70-4a53-88c3-f6132ed69865 req-bc9b05cb-ed43-479f-8945-53482eca5cd3 service nova] Creating event network-vif-plugged:779d4f23-aa71-4166-aead-3f25b367efc9 for instance a8edf80c-1741-417f-ad42-4cdf4567898f on hv-cinder-80382 Jun 22 09:10:49.635361 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-26490539-8e70-4a53-88c3-f6132ed69865 req-bc9b05cb-ed43-479f-8945-53482eca5cd3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027639 Jun 22 09:10:49.636034 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 216/445] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:50.037929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0d3be5fe-aa8b-4bcd-9ab1-7a548575b149 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.959416 Jun 22 09:10:50.038462 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 230/446] 10.222.0.55 () {62 vars in 1363 bytes} [Wed Jun 22 09:10:49 2022] POST /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments => generated 188 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 09:10:50.156059 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-beee7557-8796-4164-94ed-cd1c46aef6d7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:50.156719 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-beee7557-8796-4164-94ed-cd1c46aef6d7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:50.163137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-beee7557-8796-4164-94ed-cd1c46aef6d7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:50.163585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-beee7557-8796-4164-94ed-cd1c46aef6d7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:50.164346 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-beee7557-8796-4164-94ed-cd1c46aef6d7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:50.164782 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-beee7557-8796-4164-94ed-cd1c46aef6d7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:50.238083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b8546ac9-9be5-485c-ac5e-c7be18ffb4ad tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:50.238688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b8546ac9-9be5-485c-ac5e-c7be18ffb4ad tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:50.245449 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b8546ac9-9be5-485c-ac5e-c7be18ffb4ad tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:50.245890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b8546ac9-9be5-485c-ac5e-c7be18ffb4ad tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:50.247246 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b8546ac9-9be5-485c-ac5e-c7be18ffb4ad tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:50.247671 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b8546ac9-9be5-485c-ac5e-c7be18ffb4ad tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:50.378082 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-beee7557-8796-4164-94ed-cd1c46aef6d7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/action" status: 202 len: 0 microversion: 2.20 time: 0.227222 Jun 22 09:10:50.378752 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 217/447] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 22 09:10:50 2022] POST /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:10:50.380387 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b8546ac9-9be5-485c-ac5e-c7be18ffb4ad tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:50.389103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b8546ac9-9be5-485c-ac5e-c7be18ffb4ad tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.154993 Jun 22 09:10:50.389673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 231/448] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:50 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:50.400531 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:50.401139 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:50.407592 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:50.408032 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:50.408787 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:50.409216 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:50.547650 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:50.556301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:50.557804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:50.559575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-886fdc23-d3a7-4338-9524-5fc83cd87f1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1750 microversion: 2.20 time: 0.170893 Jun 22 09:10:50.560172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 218/449] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:50 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:51.405617 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-60948476-3036-4a3a-8d5e-bcb44d356f0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:51.406306 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-60948476-3036-4a3a-8d5e-bcb44d356f0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:51.412782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-60948476-3036-4a3a-8d5e-bcb44d356f0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:51.413263 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-60948476-3036-4a3a-8d5e-bcb44d356f0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:51.414010 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-60948476-3036-4a3a-8d5e-bcb44d356f0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:51.414437 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-60948476-3036-4a3a-8d5e-bcb44d356f0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:51.578317 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:51.579479 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:51.588080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:51.588710 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:51.589971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:51.591155 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:51.739453 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:51.749849 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:51.751654 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:51.753000 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3ac3e72e-a097-425c-929e-50e652d64dd2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1750 microversion: 2.20 time: 0.179193 Jun 22 09:10:51.753679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 219/450] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:51 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:51.758688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-9a5a10ab-3c1a-41a4-b739-21593098d7ec req-ed6744fd-5b2c-4946-9054-cd8f258d4947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c02245-d347-4fe2-8836-ca64aeb90e74", "name": "network-vif-unplugged", "status": "completed", "tag": "5897603a-c758-4aef-b13d-a1bcac6199a0"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:51.762910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-60948476-3036-4a3a-8d5e-bcb44d356f0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:51.770561 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-60948476-3036-4a3a-8d5e-bcb44d356f0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1260 microversion: 2.1 time: 0.368768 Jun 22 09:10:51.771171 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 232/451] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:51 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1260 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:51.773699 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-9a5a10ab-3c1a-41a4-b739-21593098d7ec req-ed6744fd-5b2c-4946-9054-cd8f258d4947 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:51.774126 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-9a5a10ab-3c1a-41a4-b739-21593098d7ec req-ed6744fd-5b2c-4946-9054-cd8f258d4947 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:51.775752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cc0a1828-db39-4f5d-9d6b-cf700372462d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82610842-de93-4bec-a747-3119d9805aba"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:51.776856 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cc0a1828-db39-4f5d-9d6b-cf700372462d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:51.783295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cc0a1828-db39-4f5d-9d6b-cf700372462d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:51.783743 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cc0a1828-db39-4f5d-9d6b-cf700372462d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:51.784510 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cc0a1828-db39-4f5d-9d6b-cf700372462d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:51.784933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cc0a1828-db39-4f5d-9d6b-cf700372462d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:51.785679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.compute.server_external_events [req-9a5a10ab-3c1a-41a4-b739-21593098d7ec req-ed6744fd-5b2c-4946-9054-cd8f258d4947 service nova] Unable to find a host for instance 04c02245-d347-4fe2-8836-ca64aeb90e74. Dropping event network-vif-unplugged {{(pid=118267) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 09:10:51.786538 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-9a5a10ab-3c1a-41a4-b739-21593098d7ec req-ed6744fd-5b2c-4946-9054-cd8f258d4947 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031569 Jun 22 09:10:51.787132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 220/452] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 09:10:52.772522 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:52.773205 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:52.780179 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:52.784542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:52.784542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:52.784542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:52.924508 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:52.933476 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:52.935056 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:52.936214 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cd3986ec-cb97-46b5-9733-1b648f44a335 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1750 microversion: 2.20 time: 0.167660 Jun 22 09:10:52.936778 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 221/453] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:52 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:10:52.941614 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c8cc56e4-0312-458a-8acb-f47bdd3f8dc0 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:52.942213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c8cc56e4-0312-458a-8acb-f47bdd3f8dc0 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:52.948434 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8cc56e4-0312-458a-8acb-f47bdd3f8dc0 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:52.948878 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8cc56e4-0312-458a-8acb-f47bdd3f8dc0 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:52.949840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8cc56e4-0312-458a-8acb-f47bdd3f8dc0 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:52.951453 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8cc56e4-0312-458a-8acb-f47bdd3f8dc0 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:53.087326 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c8cc56e4-0312-458a-8acb-f47bdd3f8dc0 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:53.094964 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c8cc56e4-0312-458a-8acb-f47bdd3f8dc0 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1444 microversion: 2.1 time: 0.157213 Jun 22 09:10:53.095527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 222/454] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:52 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:53.111627 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-11cd331b-fdb3-4fca-9122-795f174f34e6 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:53.112231 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-11cd331b-fdb3-4fca-9122-795f174f34e6 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:53.117991 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-11cd331b-fdb3-4fca-9122-795f174f34e6 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:53.118439 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-11cd331b-fdb3-4fca-9122-795f174f34e6 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:53.119245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-11cd331b-fdb3-4fca-9122-795f174f34e6 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:53.119695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-11cd331b-fdb3-4fca-9122-795f174f34e6 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:53.248686 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-11cd331b-fdb3-4fca-9122-795f174f34e6 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:53.256093 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-11cd331b-fdb3-4fca-9122-795f174f34e6 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1444 microversion: 2.1 time: 0.148037 Jun 22 09:10:53.256663 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 223/455] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:53 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:53.421133 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cc0a1828-db39-4f5d-9d6b-cf700372462d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.648756 Jun 22 09:10:53.421767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 233/456] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:10:51 2022] POST /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments => generated 194 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:53.953415 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:53.954012 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:53.960405 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:53.964357 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:53.964357 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:53.964357 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:54.182456 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:54.191398 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:54.196449 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:54.196449 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9eb23ed1-ed1d-481f-b5c7-74e79d7c2db6 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1752 microversion: 2.20 time: 0.244527 Jun 22 09:10:54.196449 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 224/457] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:53 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:55.214257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:55.215151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:55.217187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:55.222357 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:55.222909 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:55.223687 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:55.224192 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:55.360321 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:55.370635 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:55.372276 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:55.374623 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0fb167ce-4bd6-4775-be69-39fc5d6beb63 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1752 microversion: 2.20 time: 0.164920 Jun 22 09:10:55.375303 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 234/458] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:55 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:55.509668 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cebd4f46-5fec-4916-bf7d-ffb8443a3e1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:55.516788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cebd4f46-5fec-4916-bf7d-ffb8443a3e1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:55.517246 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cebd4f46-5fec-4916-bf7d-ffb8443a3e1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:55.583427 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cebd4f46-5fec-4916-bf7d-ffb8443a3e1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Going to try to stop instance {{(pid=118267) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 09:10:55.608804 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-fb7850e3-a820-4972-b57c-31f7e4b0ab23 req-ee69b515-a70e-4af1-bee4-a2dd8fb10962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8edf80c-1741-417f-ad42-4cdf4567898f", "tag": "779d4f23-aa71-4166-aead-3f25b367efc9"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:55.612542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-fb7850e3-a820-4972-b57c-31f7e4b0ab23 req-ee69b515-a70e-4af1-bee4-a2dd8fb10962 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:55.613050 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-fb7850e3-a820-4972-b57c-31f7e4b0ab23 req-ee69b515-a70e-4af1-bee4-a2dd8fb10962 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:55.625356 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-fb7850e3-a820-4972-b57c-31f7e4b0ab23 req-ee69b515-a70e-4af1-bee4-a2dd8fb10962 service nova] Creating event network-changed:779d4f23-aa71-4166-aead-3f25b367efc9 for instance a8edf80c-1741-417f-ad42-4cdf4567898f on hv-cinder-80382 Jun 22 09:10:55.630344 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-fb7850e3-a820-4972-b57c-31f7e4b0ab23 req-ee69b515-a70e-4af1-bee4-a2dd8fb10962 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033000 Jun 22 09:10:55.631048 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 235/459] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:10:55.768018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cebd4f46-5fec-4916-bf7d-ffb8443a3e1a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/action" status: 202 len: 0 microversion: 2.1 time: 0.261994 Jun 22 09:10:55.768543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 225/460] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:10:55 2022] POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:10:55.777193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5c4d5574-d803-4008-86f1-c1109d460bed tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:55.777897 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5c4d5574-d803-4008-86f1-c1109d460bed tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:55.784265 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5c4d5574-d803-4008-86f1-c1109d460bed tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:55.784713 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5c4d5574-d803-4008-86f1-c1109d460bed tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:55.785472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5c4d5574-d803-4008-86f1-c1109d460bed tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:55.785910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5c4d5574-d803-4008-86f1-c1109d460bed tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:55.920657 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5c4d5574-d803-4008-86f1-c1109d460bed tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:55.928578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5c4d5574-d803-4008-86f1-c1109d460bed tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.155509 Jun 22 09:10:55.929168 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 236/461] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:55 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:56.393913 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:56.394628 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:56.400894 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:56.401354 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:56.402107 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:56.402536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:56.540663 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:56.549754 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:56.551403 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:56.552624 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-23c1fa4b-2038-4841-ae22-71d20050ce59 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1752 microversion: 2.20 time: 0.163179 Jun 22 09:10:56.553258 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 226/462] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:56 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:56.945861 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-56602910-83bd-4204-8c32-fef43bb606d3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:56.946595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-56602910-83bd-4204-8c32-fef43bb606d3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:56.953813 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56602910-83bd-4204-8c32-fef43bb606d3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:56.954261 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56602910-83bd-4204-8c32-fef43bb606d3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:56.955062 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56602910-83bd-4204-8c32-fef43bb606d3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:56.955485 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56602910-83bd-4204-8c32-fef43bb606d3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:57.081647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-56602910-83bd-4204-8c32-fef43bb606d3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:57.089178 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-56602910-83bd-4204-8c32-fef43bb606d3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.147205 Jun 22 09:10:57.089741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 237/463] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:56 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:57.571098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:57.571705 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:57.578799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:57.584199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:57.584199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:57.584199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:57.599263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:57.711449 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:57.719942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:57.721457 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:57.722609 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-dcde1acb-d1d2-4e18-8b1c-4caede8bec97 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1752 microversion: 2.20 time: 0.155399 Jun 22 09:10:57.723200 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 227/464] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:57 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:58.106619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-aeed1bf2-6cc9-46d7-b7fb-412ba2c91d02 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:58.107255 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-aeed1bf2-6cc9-46d7-b7fb-412ba2c91d02 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:58.113690 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-aeed1bf2-6cc9-46d7-b7fb-412ba2c91d02 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:58.114135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-aeed1bf2-6cc9-46d7-b7fb-412ba2c91d02 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:58.114920 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-aeed1bf2-6cc9-46d7-b7fb-412ba2c91d02 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:58.115354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-aeed1bf2-6cc9-46d7-b7fb-412ba2c91d02 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:58.241816 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-aeed1bf2-6cc9-46d7-b7fb-412ba2c91d02 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:58.249870 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-aeed1bf2-6cc9-46d7-b7fb-412ba2c91d02 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.147046 Jun 22 09:10:58.250438 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 238/465] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:58 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:58.740756 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:58.741358 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:58.748527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:58.749164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:58.750079 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:58.750672 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:58.956304 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:58.965439 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:58.967580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:58.968735 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e99aea35-6313-4e2b-b008-66e63e8e7f4d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1752 microversion: 2.20 time: 0.231853 Jun 22 09:10:58.969308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 228/466] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:58 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1752 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:10:59.266549 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d760130b-1cc7-4415-8f18-a0cbbeed0203 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:59.267187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d760130b-1cc7-4415-8f18-a0cbbeed0203 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:59.273617 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d760130b-1cc7-4415-8f18-a0cbbeed0203 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:59.275109 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d760130b-1cc7-4415-8f18-a0cbbeed0203 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:59.275109 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d760130b-1cc7-4415-8f18-a0cbbeed0203 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:59.275323 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d760130b-1cc7-4415-8f18-a0cbbeed0203 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:59.293195 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:59.408924 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d760130b-1cc7-4415-8f18-a0cbbeed0203 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:59.416291 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d760130b-1cc7-4415-8f18-a0cbbeed0203 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.153568 Jun 22 09:10:59.418602 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 239/467] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:59 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:59.987121 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:59.987725 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:59.994224 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:59.999532 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:59.999532 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:59.999532 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:00.123314 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:00.131702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:00.133282 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:00.134434 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-93f67744-204b-4bda-a3e3-0fc7f9312033 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.151328 Jun 22 09:11:00.135025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 229/468] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:10:59 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:00.433760 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b4f5d0ce-4de3-457a-931e-5bc052a4f328 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:00.434358 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b4f5d0ce-4de3-457a-931e-5bc052a4f328 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:00.441896 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b4f5d0ce-4de3-457a-931e-5bc052a4f328 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:00.442334 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b4f5d0ce-4de3-457a-931e-5bc052a4f328 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:00.443113 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b4f5d0ce-4de3-457a-931e-5bc052a4f328 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:00.443544 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b4f5d0ce-4de3-457a-931e-5bc052a4f328 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:00.576208 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b4f5d0ce-4de3-457a-931e-5bc052a4f328 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:00.583855 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b4f5d0ce-4de3-457a-931e-5bc052a4f328 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.154256 Jun 22 09:11:00.584419 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 240/469] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:00 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:01.152514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:01.153154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:01.160419 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:01.160927 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:01.161684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:01.162126 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:01.287348 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:01.296240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:01.297749 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:01.298963 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-74485925-1cf3-49d2-9bf1-dfaa1a322644 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.150308 Jun 22 09:11:01.299522 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 230/470] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:01 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:01.601252 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f6761046-a51d-4424-9404-c18b67daaf88 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:01.601857 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f6761046-a51d-4424-9404-c18b67daaf88 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:01.608560 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f6761046-a51d-4424-9404-c18b67daaf88 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:01.609011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f6761046-a51d-4424-9404-c18b67daaf88 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:01.609774 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f6761046-a51d-4424-9404-c18b67daaf88 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:01.610268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f6761046-a51d-4424-9404-c18b67daaf88 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:01.748717 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f6761046-a51d-4424-9404-c18b67daaf88 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:01.756192 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f6761046-a51d-4424-9404-c18b67daaf88 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.159063 Jun 22 09:11:01.756752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 241/471] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:01 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:02.317204 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:02.317851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:02.324369 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:02.324814 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:02.325558 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:02.325989 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:02.456780 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:02.464986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:02.467013 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:02.468151 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5af4504c-7891-4e2d-a4de-53d0db874eca tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.154790 Jun 22 09:11:02.468708 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 231/472] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:02 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:02.773537 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9905f6bc-8278-4af4-9532-b0d642f4f89f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:02.774139 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9905f6bc-8278-4af4-9532-b0d642f4f89f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:02.781438 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9905f6bc-8278-4af4-9532-b0d642f4f89f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:02.781886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9905f6bc-8278-4af4-9532-b0d642f4f89f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:02.782641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9905f6bc-8278-4af4-9532-b0d642f4f89f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:02.783110 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9905f6bc-8278-4af4-9532-b0d642f4f89f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:02.909166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9905f6bc-8278-4af4-9532-b0d642f4f89f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:02.916764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9905f6bc-8278-4af4-9532-b0d642f4f89f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.147067 Jun 22 09:11:02.917333 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 242/473] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:02 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:03.486761 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:03.487535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:03.494039 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:03.494489 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:03.495283 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:03.495718 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:03.646788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:03.655689 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:03.657228 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:03.658411 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-67c4a288-fa1c-4443-ba30-e1285e0f3352 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.176095 Jun 22 09:11:03.659181 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 232/474] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:03 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:03.934253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4a7dd550-bfbc-4c94-be1e-ffc81a97135c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:03.934877 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4a7dd550-bfbc-4c94-be1e-ffc81a97135c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:03.942172 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4a7dd550-bfbc-4c94-be1e-ffc81a97135c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:03.942615 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4a7dd550-bfbc-4c94-be1e-ffc81a97135c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:03.943572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4a7dd550-bfbc-4c94-be1e-ffc81a97135c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:03.944037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4a7dd550-bfbc-4c94-be1e-ffc81a97135c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:04.090393 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4a7dd550-bfbc-4c94-be1e-ffc81a97135c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:04.098696 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4a7dd550-bfbc-4c94-be1e-ffc81a97135c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.168977 Jun 22 09:11:04.099355 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 243/475] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:03 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:04.676809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:04.677419 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:04.684536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:04.684984 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:04.685816 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:04.686251 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:04.835895 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:04.849096 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:04.851161 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:04.852513 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d430585a-c029-4820-bc9d-4fec4ce280af tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.179602 Jun 22 09:11:04.853697 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 233/476] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:04 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:05.115852 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-45500ae3-5e19-4279-afa7-359b58ee947a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:05.116471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-45500ae3-5e19-4279-afa7-359b58ee947a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:05.123014 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45500ae3-5e19-4279-afa7-359b58ee947a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:05.123462 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45500ae3-5e19-4279-afa7-359b58ee947a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:05.124436 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45500ae3-5e19-4279-afa7-359b58ee947a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:05.125059 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45500ae3-5e19-4279-afa7-359b58ee947a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:05.268929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-45500ae3-5e19-4279-afa7-359b58ee947a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:05.276485 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-45500ae3-5e19-4279-afa7-359b58ee947a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.164514 Jun 22 09:11:05.277057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 244/477] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:05 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:05.872172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:05.873312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:05.880666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:05.881194 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:05.881982 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:05.882410 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:06.084102 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:06.092883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:06.094922 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:06.096432 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-59a02a8f-e6be-49a6-bb8f-672dcc2937ec tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.228278 Jun 22 09:11:06.097593 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 234/478] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:05 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:06.293546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-484edbff-5984-4777-b9b8-e19d07644b56 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:06.294114 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-484edbff-5984-4777-b9b8-e19d07644b56 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:06.301719 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-484edbff-5984-4777-b9b8-e19d07644b56 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:06.302485 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-484edbff-5984-4777-b9b8-e19d07644b56 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:06.303502 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-484edbff-5984-4777-b9b8-e19d07644b56 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:06.304186 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-484edbff-5984-4777-b9b8-e19d07644b56 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:06.449860 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-484edbff-5984-4777-b9b8-e19d07644b56 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:06.461864 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-484edbff-5984-4777-b9b8-e19d07644b56 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.169554 Jun 22 09:11:06.461864 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 245/479] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:06 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:07.117187 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:07.117764 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:07.124814 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.125288 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.126036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.126462 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.244657 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-729927e6-bf5c-4475-8894-09a51eae28f4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:07.245530 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-729927e6-bf5c-4475-8894-09a51eae28f4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:07.251957 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-729927e6-bf5c-4475-8894-09a51eae28f4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.252813 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-729927e6-bf5c-4475-8894-09a51eae28f4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.253767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-729927e6-bf5c-4475-8894-09a51eae28f4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.254429 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-729927e6-bf5c-4475-8894-09a51eae28f4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.280632 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-729927e6-bf5c-4475-8894-09a51eae28f4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79/ips" status: 200 len: 149 microversion: 2.1 time: 0.040157 Jun 22 09:11:07.281642 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 246/480] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:11:07 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:11:07.295265 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0718f0e-d9df-4b45-8e77-2bf2191b5563"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:07.296792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:07.297188 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:07.304094 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.304541 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.305506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.306110 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.308536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:07.310154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:07.311903 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a4491db5-38ba-4726-a641-7c364c83cebd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.198360 Jun 22 09:11:07.312674 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 235/481] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:07 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:07.398138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Invalid volume: volume e0718f0e-d9df-4b45-8e77-2bf2191b5563 is already attached to instances: 139fc621-9e20-4f05-9935-92b048cc48a1 Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: POST /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79/os-volume_attachments HTTP/1.1 Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 74 Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:11:07.399900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {"volumeAttachment": {"volumeId": "e0718f0e-d9df-4b45-8e77-2bf2191b5563"}} Jun 22 09:11:07.401512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Invalid volume: volume e0718f0e-d9df-4b45-8e77-2bf2191b5563 is already attached to instances: 139fc621-9e20-4f05-9935-92b048cc48a1 Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'server_id': '27ec2434-e40b-47fc-b565-d465e3fe0f79', 'body': {'volumeAttachment': {'volumeId': 'e0718f0e-d9df-4b45-8e77-2bf2191b5563'}}} Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e0718f0e-d9df-4b45-8e77-2bf2191b5563 is already attached to instances: 139fc621-9e20-4f05-9935-92b048cc48a1 Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:07.402526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e0718f0e-d9df-4b45-8e77-2bf2191b5563 is already attached to instances: 139fc621-9e20-4f05-9935-92b048cc48a1 Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:07.403753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:07.405581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:07.405581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:11:07.405581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:11:07.405581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e0718f0e-d9df-4b45-8e77-2bf2191b5563 is already attached to instances: 139fc621-9e20-4f05-9935-92b048cc48a1 Jun 22 09:11:07.405581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:07.405581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 400 to user: Invalid volume: volume e0718f0e-d9df-4b45-8e77-2bf2191b5563 is already attached to instances: 139fc621-9e20-4f05-9935-92b048cc48a1 {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:11:07.405581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-37b20f13-3a11-4c1b-8d9d-1530b19cd133 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111387 Jun 22 09:11:07.405581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 247/482] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:11:07 2022] POST /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 09:11:07.410711 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2c76e9b9-74a6-4109-9a49-31263c148e2c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:07.411241 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2c76e9b9-74a6-4109-9a49-31263c148e2c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:07.417246 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c76e9b9-74a6-4109-9a49-31263c148e2c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.417688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c76e9b9-74a6-4109-9a49-31263c148e2c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.418435 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c76e9b9-74a6-4109-9a49-31263c148e2c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.418889 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c76e9b9-74a6-4109-9a49-31263c148e2c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.444896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2c76e9b9-74a6-4109-9a49-31263c148e2c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:11:07.478018 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7ddedb1f-db96-409e-892a-a24a6869abd3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:07.478740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7ddedb1f-db96-409e-892a-a24a6869abd3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:07.486193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7ddedb1f-db96-409e-892a-a24a6869abd3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.486718 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7ddedb1f-db96-409e-892a-a24a6869abd3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.487634 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7ddedb1f-db96-409e-892a-a24a6869abd3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.488139 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7ddedb1f-db96-409e-892a-a24a6869abd3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.624280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7ddedb1f-db96-409e-892a-a24a6869abd3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:07.631959 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7ddedb1f-db96-409e-892a-a24a6869abd3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.158346 Jun 22 09:11:07.632518 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 248/483] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:07 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:07.639106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-eb21eea6-d0cc-4556-936e-8fa4a6489ebf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:07.639609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-eb21eea6-d0cc-4556-936e-8fa4a6489ebf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:07.646683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-eb21eea6-d0cc-4556-936e-8fa4a6489ebf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.647158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-eb21eea6-d0cc-4556-936e-8fa4a6489ebf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.648028 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-eb21eea6-d0cc-4556-936e-8fa4a6489ebf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.648461 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-eb21eea6-d0cc-4556-936e-8fa4a6489ebf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.718335 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2c76e9b9-74a6-4109-9a49-31263c148e2c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 204 len: 0 microversion: 2.1 time: 0.311028 Jun 22 09:11:07.719378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 236/484] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:11:07 2022] DELETE /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:11:07.728495 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-967bd442-177b-4c82-9ffc-2e2bd4cb95a9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:07.729263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-967bd442-177b-4c82-9ffc-2e2bd4cb95a9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:07.736714 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-967bd442-177b-4c82-9ffc-2e2bd4cb95a9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.737236 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-967bd442-177b-4c82-9ffc-2e2bd4cb95a9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.738134 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-967bd442-177b-4c82-9ffc-2e2bd4cb95a9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.738740 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-967bd442-177b-4c82-9ffc-2e2bd4cb95a9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.787548 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-eb21eea6-d0cc-4556-936e-8fa4a6489ebf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lazy-loading 'services' on Instance uuid 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:11:07.901945 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-967bd442-177b-4c82-9ffc-2e2bd4cb95a9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:07.911193 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-967bd442-177b-4c82-9ffc-2e2bd4cb95a9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1680 microversion: 2.1 time: 0.186547 Jun 22 09:11:07.911815 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 237/485] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:07 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:08.043715 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-eb21eea6-d0cc-4556-936e-8fa4a6489ebf tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0/os-volume_attachments/235eca61-c063-40c9-a336-22a4e983595c" status: 202 len: 0 microversion: 2.1 time: 0.409769 Jun 22 09:11:08.045135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 249/486] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:11:07 2022] DELETE /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0/os-volume_attachments/235eca61-c063-40c9-a336-22a4e983595c => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:11:08.329479 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:08.330089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:08.336648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:08.337089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:08.337836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:08.338265 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:08.477926 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:08.487195 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:08.488801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:08.490077 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-70324b0a-f4d2-45e0-841a-9decf64e6049 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.164512 Jun 22 09:11:08.490979 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 238/487] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:08 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:08.650353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f201d10a-026d-4539-85c7-ae72cdc77166 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:08.651968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f201d10a-026d-4539-85c7-ae72cdc77166 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:08.658915 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f201d10a-026d-4539-85c7-ae72cdc77166 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:08.659368 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f201d10a-026d-4539-85c7-ae72cdc77166 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:08.660144 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f201d10a-026d-4539-85c7-ae72cdc77166 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:08.660578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f201d10a-026d-4539-85c7-ae72cdc77166 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:08.795285 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f201d10a-026d-4539-85c7-ae72cdc77166 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:08.803173 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f201d10a-026d-4539-85c7-ae72cdc77166 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.157394 Jun 22 09:11:08.804103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 250/488] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:08 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:08.929533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-afa911c4-8ecd-4ed6-99ad-c30b0657bc8f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:08.930131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-afa911c4-8ecd-4ed6-99ad-c30b0657bc8f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:08.936754 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afa911c4-8ecd-4ed6-99ad-c30b0657bc8f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:08.937206 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afa911c4-8ecd-4ed6-99ad-c30b0657bc8f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:08.938099 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afa911c4-8ecd-4ed6-99ad-c30b0657bc8f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:08.938529 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afa911c4-8ecd-4ed6-99ad-c30b0657bc8f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:09.073063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-afa911c4-8ecd-4ed6-99ad-c30b0657bc8f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:09.081203 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-afa911c4-8ecd-4ed6-99ad-c30b0657bc8f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1680 microversion: 2.1 time: 0.155535 Jun 22 09:11:09.081774 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 239/489] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:08 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:09.509410 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:09.510016 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:09.516548 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:09.516989 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:09.517733 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:09.518161 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:09.660311 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:09.668597 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:09.670151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:09.671317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-236fa4a2-b8f2-4cb2-b499-fecc975d45b3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.165872 Jun 22 09:11:09.671880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 251/490] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:09 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:09.820832 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-203756bf-14e7-4732-8fbf-cebd21ff7c45 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:09.821479 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-203756bf-14e7-4732-8fbf-cebd21ff7c45 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:09.829096 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-203756bf-14e7-4732-8fbf-cebd21ff7c45 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:09.829550 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-203756bf-14e7-4732-8fbf-cebd21ff7c45 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:09.830325 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-203756bf-14e7-4732-8fbf-cebd21ff7c45 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:09.830768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-203756bf-14e7-4732-8fbf-cebd21ff7c45 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:09.963777 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-203756bf-14e7-4732-8fbf-cebd21ff7c45 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:09.972481 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-203756bf-14e7-4732-8fbf-cebd21ff7c45 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.155560 Jun 22 09:11:09.973060 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 240/491] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:09 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:10.098554 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-82d49397-4efe-489d-bcd7-d1bd2f0262eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:10.099416 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-82d49397-4efe-489d-bcd7-d1bd2f0262eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:10.106498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-82d49397-4efe-489d-bcd7-d1bd2f0262eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:10.108886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-82d49397-4efe-489d-bcd7-d1bd2f0262eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:10.109759 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-82d49397-4efe-489d-bcd7-d1bd2f0262eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:10.110215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-82d49397-4efe-489d-bcd7-d1bd2f0262eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:10.260221 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-82d49397-4efe-489d-bcd7-d1bd2f0262eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:10.268130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-82d49397-4efe-489d-bcd7-d1bd2f0262eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1680 microversion: 2.1 time: 0.173395 Jun 22 09:11:10.268807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 252/492] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:10 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:10.689853 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:10.690457 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:10.696787 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:10.697254 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:10.698022 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:10.698434 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:10.829142 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:10.837750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:10.839312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:10.840488 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b0d66b67-ef25-440b-86c4-0469d4a6429d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.154588 Jun 22 09:11:10.842993 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 241/493] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:10 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:10.990240 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-43069c44-ed3f-4301-962c-656cfababeae tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:10.990792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-43069c44-ed3f-4301-962c-656cfababeae tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:10.997668 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-43069c44-ed3f-4301-962c-656cfababeae tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:11.002064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-43069c44-ed3f-4301-962c-656cfababeae tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:11.002064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-43069c44-ed3f-4301-962c-656cfababeae tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:11.002064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-43069c44-ed3f-4301-962c-656cfababeae tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:11.133726 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-43069c44-ed3f-4301-962c-656cfababeae tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:11.141907 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-43069c44-ed3f-4301-962c-656cfababeae tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.155605 Jun 22 09:11:11.142524 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 253/494] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:10 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:11.286083 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d6392bc1-c70e-4f1f-83b8-25a876d1fc4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:11.286695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d6392bc1-c70e-4f1f-83b8-25a876d1fc4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:11.292749 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6392bc1-c70e-4f1f-83b8-25a876d1fc4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:11.293206 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6392bc1-c70e-4f1f-83b8-25a876d1fc4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:11.293987 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6392bc1-c70e-4f1f-83b8-25a876d1fc4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:11.295080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6392bc1-c70e-4f1f-83b8-25a876d1fc4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:11.313770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:11.455435 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d6392bc1-c70e-4f1f-83b8-25a876d1fc4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:11.465349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d6392bc1-c70e-4f1f-83b8-25a876d1fc4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1680 microversion: 2.1 time: 0.183045 Jun 22 09:11:11.466000 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 242/495] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:11 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:11.859480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:11.860099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:11.866172 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:11.866626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:11.867417 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:11.867850 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:12.005303 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:12.014961 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:12.016491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:12.017660 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a48ff775-6978-4c8b-9b5f-ddc74ed1f291 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.162168 Jun 22 09:11:12.018231 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 254/496] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:11 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:12.160286 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f177a80d-d46d-4cbb-978f-237edceff0c8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:12.161136 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f177a80d-d46d-4cbb-978f-237edceff0c8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:12.169116 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f177a80d-d46d-4cbb-978f-237edceff0c8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:12.170167 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f177a80d-d46d-4cbb-978f-237edceff0c8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:12.170989 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f177a80d-d46d-4cbb-978f-237edceff0c8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:12.171426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f177a80d-d46d-4cbb-978f-237edceff0c8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:12.310653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f177a80d-d46d-4cbb-978f-237edceff0c8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:12.318561 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f177a80d-d46d-4cbb-978f-237edceff0c8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.162405 Jun 22 09:11:12.319461 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 243/497] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:12 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:12.483981 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4b27cb79-1cac-4487-9c12-e5c0753f2151 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:12.484817 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4b27cb79-1cac-4487-9c12-e5c0753f2151 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:12.491054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4b27cb79-1cac-4487-9c12-e5c0753f2151 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:12.491577 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4b27cb79-1cac-4487-9c12-e5c0753f2151 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:12.492415 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4b27cb79-1cac-4487-9c12-e5c0753f2151 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:12.492914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4b27cb79-1cac-4487-9c12-e5c0753f2151 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:12.648984 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4b27cb79-1cac-4487-9c12-e5c0753f2151 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:12.652974 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:12.659869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4b27cb79-1cac-4487-9c12-e5c0753f2151 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1680 microversion: 2.1 time: 0.180041 Jun 22 09:11:12.670042 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 255/498] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:12 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:13.036123 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:13.036870 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:13.043836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:13.044292 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:13.045671 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:13.046110 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:13.181104 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:13.189755 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:13.191325 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:13.192476 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8ac1957d-520d-4852-8dd3-873eae43e09d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.160477 Jun 22 09:11:13.194226 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 244/499] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:13 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:13.337802 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-570b20e3-6121-4889-93dc-aef43bb343f8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:13.337802 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-570b20e3-6121-4889-93dc-aef43bb343f8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:13.351219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-570b20e3-6121-4889-93dc-aef43bb343f8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:13.351219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-570b20e3-6121-4889-93dc-aef43bb343f8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:13.351219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-570b20e3-6121-4889-93dc-aef43bb343f8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:13.351219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-570b20e3-6121-4889-93dc-aef43bb343f8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:13.511044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-570b20e3-6121-4889-93dc-aef43bb343f8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:13.519097 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-570b20e3-6121-4889-93dc-aef43bb343f8 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.186151 Jun 22 09:11:13.519682 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 256/500] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:13 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:13.677487 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f1a49d9a-7012-451e-884d-027f41d30455 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:13.678086 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f1a49d9a-7012-451e-884d-027f41d30455 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:13.684175 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1a49d9a-7012-451e-884d-027f41d30455 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:13.684613 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1a49d9a-7012-451e-884d-027f41d30455 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:13.685402 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1a49d9a-7012-451e-884d-027f41d30455 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:13.685943 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1a49d9a-7012-451e-884d-027f41d30455 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:13.817321 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f1a49d9a-7012-451e-884d-027f41d30455 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:13.824858 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f1a49d9a-7012-451e-884d-027f41d30455 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1680 microversion: 2.1 time: 0.151174 Jun 22 09:11:13.825428 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 245/501] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:13 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:14.210723 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:14.211292 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:14.218249 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:14.218698 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:14.219491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:14.219926 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:14.352872 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:14.362512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:14.364106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:14.365295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-781acab6-e46c-475d-804e-55db8b8e0cb7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.158529 Jun 22 09:11:14.365842 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 257/502] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:14 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:14.535990 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2595f7eb-bf42-4f77-a355-0f9b025316a5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:14.536511 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2595f7eb-bf42-4f77-a355-0f9b025316a5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:14.538927 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:14.543607 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2595f7eb-bf42-4f77-a355-0f9b025316a5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:14.544052 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2595f7eb-bf42-4f77-a355-0f9b025316a5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:14.545434 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2595f7eb-bf42-4f77-a355-0f9b025316a5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:14.545868 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2595f7eb-bf42-4f77-a355-0f9b025316a5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:14.678023 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2595f7eb-bf42-4f77-a355-0f9b025316a5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:14.686221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2595f7eb-bf42-4f77-a355-0f9b025316a5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1677 microversion: 2.1 time: 0.154197 Jun 22 09:11:14.686788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 246/503] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:14 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:14.842941 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0611d3f1-cf29-46ad-bc22-4b0c5d004ba9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:14.843477 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0611d3f1-cf29-46ad-bc22-4b0c5d004ba9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:14.849646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0611d3f1-cf29-46ad-bc22-4b0c5d004ba9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:14.850997 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0611d3f1-cf29-46ad-bc22-4b0c5d004ba9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:14.851140 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0611d3f1-cf29-46ad-bc22-4b0c5d004ba9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:14.851561 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0611d3f1-cf29-46ad-bc22-4b0c5d004ba9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:14.985378 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0611d3f1-cf29-46ad-bc22-4b0c5d004ba9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:14.992827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0611d3f1-cf29-46ad-bc22-4b0c5d004ba9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1680 microversion: 2.1 time: 0.154321 Jun 22 09:11:14.993391 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 258/504] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:14 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:15.383765 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:15.384371 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:15.391026 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:15.391472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:15.392221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:15.392652 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:15.523768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:15.532624 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:15.534113 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:15.535279 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-eff0a738-225d-48c1-ae15-5328e5661ad7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.155771 Jun 22 09:11:15.535832 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 247/505] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:15 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:15.703680 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5dedc906-0dc1-4bb0-bbf4-ba31299d1e74 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:15.704286 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5dedc906-0dc1-4bb0-bbf4-ba31299d1e74 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:15.710676 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5dedc906-0dc1-4bb0-bbf4-ba31299d1e74 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:15.711159 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5dedc906-0dc1-4bb0-bbf4-ba31299d1e74 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:15.711924 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5dedc906-0dc1-4bb0-bbf4-ba31299d1e74 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:15.712359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5dedc906-0dc1-4bb0-bbf4-ba31299d1e74 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:15.842286 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5dedc906-0dc1-4bb0-bbf4-ba31299d1e74 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:15.850068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5dedc906-0dc1-4bb0-bbf4-ba31299d1e74 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1654 microversion: 2.1 time: 0.150789 Jun 22 09:11:15.850906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 259/506] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:15 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:15.867388 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9eb73c69-2e9c-4ce1-b0d6-5d289b6ebb00 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:15.874343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9eb73c69-2e9c-4ce1-b0d6-5d289b6ebb00 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:15.874789 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9eb73c69-2e9c-4ce1-b0d6-5d289b6ebb00 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:15.896498 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9eb73c69-2e9c-4ce1-b0d6-5d289b6ebb00 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Going to try to start instance {{(pid=118267) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 09:11:16.009965 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2f12287e-a1c3-4674-b659-6b4e5dfad0ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:16.010575 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2f12287e-a1c3-4674-b659-6b4e5dfad0ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:16.017335 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2f12287e-a1c3-4674-b659-6b4e5dfad0ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:16.017784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2f12287e-a1c3-4674-b659-6b4e5dfad0ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:16.018610 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2f12287e-a1c3-4674-b659-6b4e5dfad0ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:16.019074 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2f12287e-a1c3-4674-b659-6b4e5dfad0ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:16.065377 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9eb73c69-2e9c-4ce1-b0d6-5d289b6ebb00 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/action" status: 202 len: 0 microversion: 2.1 time: 0.201778 Jun 22 09:11:16.065980 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 248/507] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:11:15 2022] POST /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:11:16.074103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-dd39ab8f-fd30-4dac-a03b-d28b5f3a24f9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:16.074807 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-dd39ab8f-fd30-4dac-a03b-d28b5f3a24f9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:16.081301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dd39ab8f-fd30-4dac-a03b-d28b5f3a24f9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:16.081922 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dd39ab8f-fd30-4dac-a03b-d28b5f3a24f9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:16.082686 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dd39ab8f-fd30-4dac-a03b-d28b5f3a24f9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:16.083153 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dd39ab8f-fd30-4dac-a03b-d28b5f3a24f9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:16.152065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2f12287e-a1c3-4674-b659-6b4e5dfad0ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:16.159593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2f12287e-a1c3-4674-b659-6b4e5dfad0ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1680 microversion: 2.1 time: 0.153566 Jun 22 09:11:16.160636 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 260/508] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:16 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:16.210456 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-dd39ab8f-fd30-4dac-a03b-d28b5f3a24f9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:16.217874 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-dd39ab8f-fd30-4dac-a03b-d28b5f3a24f9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1663 microversion: 2.1 time: 0.147680 Jun 22 09:11:16.218443 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 249/509] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:16 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:16.557294 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:16.560768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:16.564310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:16.564759 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:16.565517 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:16.565981 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:16.692566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:16.701036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:16.702542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:16.703728 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-76eed42b-2dd8-491d-ba18-e1a492a936c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.155077 Jun 22 09:11:16.714075 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 261/510] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:16 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:17.176682 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ae828e89-ea28-49f5-bf85-ae7d307dfbf0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:17.177284 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ae828e89-ea28-49f5-bf85-ae7d307dfbf0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:17.183715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ae828e89-ea28-49f5-bf85-ae7d307dfbf0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:17.184160 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ae828e89-ea28-49f5-bf85-ae7d307dfbf0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:17.185519 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ae828e89-ea28-49f5-bf85-ae7d307dfbf0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:17.185966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ae828e89-ea28-49f5-bf85-ae7d307dfbf0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:17.235286 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bb32b863-547e-44b0-8abe-013df74c232a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:17.235885 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bb32b863-547e-44b0-8abe-013df74c232a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:17.242205 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bb32b863-547e-44b0-8abe-013df74c232a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:17.242642 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bb32b863-547e-44b0-8abe-013df74c232a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:17.243423 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bb32b863-547e-44b0-8abe-013df74c232a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:17.243853 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bb32b863-547e-44b0-8abe-013df74c232a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:17.376557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bb32b863-547e-44b0-8abe-013df74c232a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:17.384512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bb32b863-547e-44b0-8abe-013df74c232a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1663 microversion: 2.1 time: 0.153189 Jun 22 09:11:17.385276 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 262/511] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:17 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:17.493766 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ae828e89-ea28-49f5-bf85-ae7d307dfbf0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:17.502210 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ae828e89-ea28-49f5-bf85-ae7d307dfbf0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1680 microversion: 2.1 time: 0.329432 Jun 22 09:11:17.502779 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 250/512] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:17 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1680 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:17.722536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:17.723357 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:17.730168 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:17.730627 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:17.731434 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:17.732368 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:17.866671 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-48031e03-215c-4beb-a68c-5c1cfbdbb8b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:17.868049 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-48031e03-215c-4beb-a68c-5c1cfbdbb8b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:17.875510 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-48031e03-215c-4beb-a68c-5c1cfbdbb8b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:17.875960 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-48031e03-215c-4beb-a68c-5c1cfbdbb8b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:17.876791 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-48031e03-215c-4beb-a68c-5c1cfbdbb8b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:17.877163 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-48031e03-215c-4beb-a68c-5c1cfbdbb8b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:17.900208 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-48031e03-215c-4beb-a68c-5c1cfbdbb8b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lazy-loading 'flavor' on Instance uuid 6e593a5f-2134-4ca1-95b8-5f2e454dca54 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:11:17.900960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:17.911706 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:17.913292 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:17.914468 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-945c98dc-b593-4870-9ba1-d0080a54128b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.196039 Jun 22 09:11:17.924678 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 263/513] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:17 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:18.266344 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-48031e03-215c-4beb-a68c-5c1cfbdbb8b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/action" status: 200 len: 32 microversion: 2.1 time: 0.403595 Jun 22 09:11:18.267142 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 251/514] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:11:17 2022] POST /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 09:11:18.275993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5cd662e6-7458-4a69-872a-975a6f7efd8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:18.276911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5cd662e6-7458-4a69-872a-975a6f7efd8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:18.284459 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5cd662e6-7458-4a69-872a-975a6f7efd8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:18.285236 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5cd662e6-7458-4a69-872a-975a6f7efd8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:18.286173 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5cd662e6-7458-4a69-872a-975a6f7efd8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:18.286770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5cd662e6-7458-4a69-872a-975a6f7efd8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:18.401954 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b7a2d6a9-f644-41fa-ae7d-84d2e892e95e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:18.403017 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b7a2d6a9-f644-41fa-ae7d-84d2e892e95e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:18.410622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b7a2d6a9-f644-41fa-ae7d-84d2e892e95e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:18.411415 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b7a2d6a9-f644-41fa-ae7d-84d2e892e95e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:18.412273 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b7a2d6a9-f644-41fa-ae7d-84d2e892e95e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:18.412771 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b7a2d6a9-f644-41fa-ae7d-84d2e892e95e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:18.437231 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5cd662e6-7458-4a69-872a-975a6f7efd8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:18.445922 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5cd662e6-7458-4a69-872a-975a6f7efd8a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.173740 Jun 22 09:11:18.446844 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 264/515] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:18 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:18.521033 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-478e3dc7-b2b1-4950-a94f-09f1b42455a6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:18.522058 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-478e3dc7-b2b1-4950-a94f-09f1b42455a6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:18.539280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-478e3dc7-b2b1-4950-a94f-09f1b42455a6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:18.540070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-478e3dc7-b2b1-4950-a94f-09f1b42455a6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:18.541106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-478e3dc7-b2b1-4950-a94f-09f1b42455a6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:18.542445 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-478e3dc7-b2b1-4950-a94f-09f1b42455a6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:18.646779 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-478e3dc7-b2b1-4950-a94f-09f1b42455a6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:18.655137 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-478e3dc7-b2b1-4950-a94f-09f1b42455a6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1613 microversion: 2.1 time: 0.139326 Jun 22 09:11:18.660134 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 265/516] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:18 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1613 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:18.852707 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b7a2d6a9-f644-41fa-ae7d-84d2e892e95e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:18.862771 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b7a2d6a9-f644-41fa-ae7d-84d2e892e95e tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1663 microversion: 2.1 time: 0.464899 Jun 22 09:11:18.863536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 252/517] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:18 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1663 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:18.933454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:18.934846 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:18.942766 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:18.943298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:18.944313 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:18.944839 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.179259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-c23792dc-3a7b-47d8-a2ac-ada8983cff3d req-39afabd0-4289-4cbb-a4c9-72082abc42ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ec2434-e40b-47fc-b565-d465e3fe0f79", "name": "network-vif-deleted", "tag": "ea94d4c1-1187-4b56-802a-ec257ccfe3bf"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:19.182052 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:19.195296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:19.195548 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c23792dc-3a7b-47d8-a2ac-ada8983cff3d req-39afabd0-4289-4cbb-a4c9-72082abc42ee service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.197423 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:19.198990 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c910c83c-a312-4e30-bc14-d05f6901fc95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.269475 Jun 22 09:11:19.200541 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c23792dc-3a7b-47d8-a2ac-ada8983cff3d req-39afabd0-4289-4cbb-a4c9-72082abc42ee service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.211822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 266/518] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:18 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:19.221199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-c23792dc-3a7b-47d8-a2ac-ada8983cff3d req-39afabd0-4289-4cbb-a4c9-72082abc42ee service nova] Creating event network-vif-deleted:ea94d4c1-1187-4b56-802a-ec257ccfe3bf for instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 on hv-cinder-80382 Jun 22 09:11:19.227020 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-c23792dc-3a7b-47d8-a2ac-ada8983cff3d req-39afabd0-4289-4cbb-a4c9-72082abc42ee service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052064 Jun 22 09:11:19.228063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 253/519] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:19.464499 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3e471c00-a53b-42b3-810e-db0c64c99816 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:19.465093 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3e471c00-a53b-42b3-810e-db0c64c99816 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:19.472221 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3e471c00-a53b-42b3-810e-db0c64c99816 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.472666 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3e471c00-a53b-42b3-810e-db0c64c99816 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.473437 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3e471c00-a53b-42b3-810e-db0c64c99816 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.473867 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3e471c00-a53b-42b3-810e-db0c64c99816 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.619163 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-3e471c00-a53b-42b3-810e-db0c64c99816 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:19.627605 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3e471c00-a53b-42b3-810e-db0c64c99816 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.167016 Jun 22 09:11:19.628370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 267/520] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:19 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:19.679464 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:19.680262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:19.686898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.690162 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.693244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.693821 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.745014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.745784 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.746440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'fault' on Instance uuid 27ec2434-e40b-47fc-b565-d465e3fe0f79 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:11:19.752626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bfa94e9f-9324-45d9-975f-2ec09c17172d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:19.753959 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bfa94e9f-9324-45d9-975f-2ec09c17172d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:19.761388 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bfa94e9f-9324-45d9-975f-2ec09c17172d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.762353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bfa94e9f-9324-45d9-975f-2ec09c17172d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.764215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bfa94e9f-9324-45d9-975f-2ec09c17172d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.764781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bfa94e9f-9324-45d9-975f-2ec09c17172d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.797973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bfa94e9f-9324-45d9-975f-2ec09c17172d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Going to try to terminate instance {{(pid=118268) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:11:19.805014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:19.813055 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ce7eacaf-2e41-4a48-90ea-d7716b1c6254 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1331 microversion: 2.1 time: 0.138892 Jun 22 09:11:19.814190 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 254/521] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:19 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:19.879863 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-38fee71d-8cdf-416d-9a73-2a04ab4e388a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:19.880580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-38fee71d-8cdf-416d-9a73-2a04ab4e388a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:19.888921 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-38fee71d-8cdf-416d-9a73-2a04ab4e388a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.895655 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-38fee71d-8cdf-416d-9a73-2a04ab4e388a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:19.895655 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-38fee71d-8cdf-416d-9a73-2a04ab4e388a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:19.895655 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-38fee71d-8cdf-416d-9a73-2a04ab4e388a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.051973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-38fee71d-8cdf-416d-9a73-2a04ab4e388a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:20.062002 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-38fee71d-8cdf-416d-9a73-2a04ab4e388a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1663 microversion: 2.1 time: 0.185243 Jun 22 09:11:20.062519 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 255/522] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:19 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1663 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:20.102106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bfa94e9f-9324-45d9-975f-2ec09c17172d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 204 len: 0 microversion: 2.1 time: 0.353109 Jun 22 09:11:20.102692 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 268/523] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:11:19 2022] DELETE /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:11:20.114183 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b325e72b-00e2-41ae-a525-b296fcfc2619 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:20.114183 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b325e72b-00e2-41ae-a525-b296fcfc2619 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:20.118859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b325e72b-00e2-41ae-a525-b296fcfc2619 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:20.119303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b325e72b-00e2-41ae-a525-b296fcfc2619 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.120077 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b325e72b-00e2-41ae-a525-b296fcfc2619 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:20.120508 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b325e72b-00e2-41ae-a525-b296fcfc2619 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.146871 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:20.221179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:20.221886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:20.229207 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:20.229659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.230750 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:20.231293 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.293695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b325e72b-00e2-41ae-a525-b296fcfc2619 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:20.302347 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b325e72b-00e2-41ae-a525-b296fcfc2619 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1514 microversion: 2.1 time: 0.195431 Jun 22 09:11:20.303053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 256/524] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:20 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:20.376437 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:20.391330 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:20.393023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:20.394570 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b6b40973-7efb-40d5-bb88-468a97e08381 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.180741 Jun 22 09:11:20.396279 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 269/525] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:20 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:11:20.645127 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9bd68b0d-04b2-4519-90a2-e7b7f5b3a362 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:20.645676 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9bd68b0d-04b2-4519-90a2-e7b7f5b3a362 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:20.651656 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9bd68b0d-04b2-4519-90a2-e7b7f5b3a362 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:20.652089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9bd68b0d-04b2-4519-90a2-e7b7f5b3a362 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.652830 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9bd68b0d-04b2-4519-90a2-e7b7f5b3a362 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:20.653306 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9bd68b0d-04b2-4519-90a2-e7b7f5b3a362 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.778404 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9bd68b0d-04b2-4519-90a2-e7b7f5b3a362 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:20.787040 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9bd68b0d-04b2-4519-90a2-e7b7f5b3a362 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.145756 Jun 22 09:11:20.787806 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 257/526] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:20 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:20.829576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:20.830366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:20.837093 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:20.837618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.838489 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:20.839036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.873294 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:20.873743 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:20.874196 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'fault' on Instance uuid 27ec2434-e40b-47fc-b565-d465e3fe0f79 {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:11:20.877248 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:20.922434 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:20.929826 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9050df95-1b91-4306-b56c-a6990f77a47d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1331 microversion: 2.1 time: 0.104102 Jun 22 09:11:20.930626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 270/527] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:20 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:21.079049 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6bc3e422-d9a1-48c9-9e2b-9ddc86f49eb5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:21.079584 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6bc3e422-d9a1-48c9-9e2b-9ddc86f49eb5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:21.085640 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6bc3e422-d9a1-48c9-9e2b-9ddc86f49eb5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.086082 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6bc3e422-d9a1-48c9-9e2b-9ddc86f49eb5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.086861 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6bc3e422-d9a1-48c9-9e2b-9ddc86f49eb5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.087285 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6bc3e422-d9a1-48c9-9e2b-9ddc86f49eb5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.218298 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-6bc3e422-d9a1-48c9-9e2b-9ddc86f49eb5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:21.225678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6bc3e422-d9a1-48c9-9e2b-9ddc86f49eb5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1667 microversion: 2.1 time: 0.150598 Jun 22 09:11:21.226507 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 258/528] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:21 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:21.319986 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8129665a-8231-4837-b9df-034056258e93 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:21.320587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8129665a-8231-4837-b9df-034056258e93 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:21.327971 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8129665a-8231-4837-b9df-034056258e93 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.328722 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8129665a-8231-4837-b9df-034056258e93 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.330028 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8129665a-8231-4837-b9df-034056258e93 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.330796 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8129665a-8231-4837-b9df-034056258e93 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.412697 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:21.413296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:21.419871 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.420247 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.420993 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.421421 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.463845 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8129665a-8231-4837-b9df-034056258e93 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:21.471809 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8129665a-8231-4837-b9df-034056258e93 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1514 microversion: 2.1 time: 0.156084 Jun 22 09:11:21.472375 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 271/529] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:21 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:21.549010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:21.557284 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:21.558775 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:21.560022 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-07268b90-d3e1-4059-ab8e-80d7035a090a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.151119 Jun 22 09:11:21.560574 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 259/530] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:21 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:11:21.804386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-28dcbba5-0441-4751-a670-5d803a4b6233 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:21.804988 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-28dcbba5-0441-4751-a670-5d803a4b6233 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:21.810976 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-28dcbba5-0441-4751-a670-5d803a4b6233 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.811416 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-28dcbba5-0441-4751-a670-5d803a4b6233 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.812159 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-28dcbba5-0441-4751-a670-5d803a4b6233 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.812586 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-28dcbba5-0441-4751-a670-5d803a4b6233 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.936786 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-28dcbba5-0441-4751-a670-5d803a4b6233 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:21.944774 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-28dcbba5-0441-4751-a670-5d803a4b6233 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.144237 Jun 22 09:11:21.945500 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 272/531] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:21 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:21.946955 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:21.947601 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:21.959002 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.959523 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.960325 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.960760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.991884 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:21.992327 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:21.992773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'fault' on Instance uuid 27ec2434-e40b-47fc-b565-d465e3fe0f79 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:11:22.035849 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:22.043193 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d7bdc6a1-3a70-4333-afc4-86fbdb0acdf4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1331 microversion: 2.1 time: 0.100044 Jun 22 09:11:22.043758 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 260/532] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:21 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:22.489100 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d8f6cb2d-6ed1-4852-a80c-a5d37f20c4a6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:22.489731 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d8f6cb2d-6ed1-4852-a80c-a5d37f20c4a6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:22.495668 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d8f6cb2d-6ed1-4852-a80c-a5d37f20c4a6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:22.496103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d8f6cb2d-6ed1-4852-a80c-a5d37f20c4a6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:22.496840 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d8f6cb2d-6ed1-4852-a80c-a5d37f20c4a6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:22.497263 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d8f6cb2d-6ed1-4852-a80c-a5d37f20c4a6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:22.578096 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:22.578771 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:22.585460 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:22.585901 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:22.586654 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:22.587107 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:22.631192 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d8f6cb2d-6ed1-4852-a80c-a5d37f20c4a6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:22.637404 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d8f6cb2d-6ed1-4852-a80c-a5d37f20c4a6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1514 microversion: 2.1 time: 0.152085 Jun 22 09:11:22.637986 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 273/533] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:22 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:22.719072 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:22.727858 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:22.729371 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:22.730525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bea42bc0-e0c2-48c1-a31f-44b2ae71e799 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.156983 Jun 22 09:11:22.731110 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 261/534] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:22 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:11:22.961370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bc53cf80-7ea7-4e7e-b4bc-dd8ed1d077b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:22.962000 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bc53cf80-7ea7-4e7e-b4bc-dd8ed1d077b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:22.969044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc53cf80-7ea7-4e7e-b4bc-dd8ed1d077b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:22.969482 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc53cf80-7ea7-4e7e-b4bc-dd8ed1d077b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:22.970222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc53cf80-7ea7-4e7e-b4bc-dd8ed1d077b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:22.970651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bc53cf80-7ea7-4e7e-b4bc-dd8ed1d077b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:23.060635 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:23.061334 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:23.067483 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:23.068019 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:23.068847 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:23.069281 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:23.100191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:23.100634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:23.101353 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'fault' on Instance uuid 27ec2434-e40b-47fc-b565-d465e3fe0f79 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:11:23.101902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bc53cf80-7ea7-4e7e-b4bc-dd8ed1d077b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:23.110482 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bc53cf80-7ea7-4e7e-b4bc-dd8ed1d077b7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.152912 Jun 22 09:11:23.111089 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 274/535] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:22 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:23.142540 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:23.149987 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-94bb1246-c996-412a-85b5-44fabf775636 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1331 microversion: 2.1 time: 0.093143 Jun 22 09:11:23.150543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 262/536] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:23 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:23.656560 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b86a0e72-fa44-4840-8aa7-80df0c7e1b49 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:23.657093 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b86a0e72-fa44-4840-8aa7-80df0c7e1b49 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:23.663045 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b86a0e72-fa44-4840-8aa7-80df0c7e1b49 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:23.663496 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b86a0e72-fa44-4840-8aa7-80df0c7e1b49 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:23.664245 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b86a0e72-fa44-4840-8aa7-80df0c7e1b49 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:23.664668 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b86a0e72-fa44-4840-8aa7-80df0c7e1b49 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:23.749248 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:23.749861 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:23.756354 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:23.756801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:23.757560 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:23.757995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:23.797667 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b86a0e72-fa44-4840-8aa7-80df0c7e1b49 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:23.805294 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b86a0e72-fa44-4840-8aa7-80df0c7e1b49 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1514 microversion: 2.1 time: 0.153614 Jun 22 09:11:23.805872 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 275/537] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:23 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:23.889036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:23.897301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:23.898804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:23.899973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e17db182-683c-492f-9444-c33e4bfa148e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.154593 Jun 22 09:11:23.900526 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 263/538] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:23 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:11:24.126558 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5adf81ec-03f0-4ef7-913b-ffe3815d21de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:24.127191 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5adf81ec-03f0-4ef7-913b-ffe3815d21de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:24.133601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5adf81ec-03f0-4ef7-913b-ffe3815d21de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.134049 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5adf81ec-03f0-4ef7-913b-ffe3815d21de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:24.134834 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5adf81ec-03f0-4ef7-913b-ffe3815d21de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.135263 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5adf81ec-03f0-4ef7-913b-ffe3815d21de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:24.171852 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:24.172483 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:24.178593 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.179070 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:24.179825 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.180257 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:24.211119 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.211559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:24.212480 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'fault' on Instance uuid 27ec2434-e40b-47fc-b565-d465e3fe0f79 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:11:24.252530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:24.260163 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0cefb56f-3559-4343-b69c-c34d0dab12f9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 200 len: 1331 microversion: 2.1 time: 0.092659 Jun 22 09:11:24.260733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 264/539] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:24 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:24.262838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5adf81ec-03f0-4ef7-913b-ffe3815d21de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:24.271382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5adf81ec-03f0-4ef7-913b-ffe3815d21de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.148736 Jun 22 09:11:24.271938 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 276/540] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:24 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:24.764552 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-f4e626f9-d3a6-4e90-8a74-2f41fb266aba req-56f81e81-8d89-445d-81c7-2a3673c410e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9ac4e6-8316-4cc4-b764-ee64344dffe0", "name": "network-vif-deleted", "tag": "41924fe0-4d4e-4cee-b82a-b4bc77edf045"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:24.773016 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-f4e626f9-d3a6-4e90-8a74-2f41fb266aba req-56f81e81-8d89-445d-81c7-2a3673c410e9 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.773454 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-f4e626f9-d3a6-4e90-8a74-2f41fb266aba req-56f81e81-8d89-445d-81c7-2a3673c410e9 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:24.784282 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-f4e626f9-d3a6-4e90-8a74-2f41fb266aba req-56f81e81-8d89-445d-81c7-2a3673c410e9 service nova] Creating event network-vif-deleted:41924fe0-4d4e-4cee-b82a-b4bc77edf045 for instance 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 on hv-cinder-80382 Jun 22 09:11:24.789754 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-f4e626f9-d3a6-4e90-8a74-2f41fb266aba req-56f81e81-8d89-445d-81c7-2a3673c410e9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029737 Jun 22 09:11:24.790327 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 265/541] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:24.821852 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d67d7c10-497a-4d53-87c1-bfe1ebfe966d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:24.827948 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d67d7c10-497a-4d53-87c1-bfe1ebfe966d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:24.829066 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d67d7c10-497a-4d53-87c1-bfe1ebfe966d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.829507 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d67d7c10-497a-4d53-87c1-bfe1ebfe966d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:24.830369 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d67d7c10-497a-4d53-87c1-bfe1ebfe966d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.830795 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d67d7c10-497a-4d53-87c1-bfe1ebfe966d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:24.892306 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d67d7c10-497a-4d53-87c1-bfe1ebfe966d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4468a51c478d4fd38f2bc3066dff63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd1375c6784f58a77c9b508ff282c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:24.899894 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d67d7c10-497a-4d53-87c1-bfe1ebfe966d tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 200 len: 1472 microversion: 2.1 time: 0.081892 Jun 22 09:11:24.900455 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 277/542] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:24 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 1472 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:24.918738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:24.919555 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:24.925942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.926331 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:24.927113 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:24.927575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:25.061333 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:25.069641 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:25.071211 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:25.072418 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-304a753e-d63b-450b-8bb6-db9fafd5eacf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.157932 Jun 22 09:11:25.072986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 266/543] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:24 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:25.277157 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:25.277756 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:25.284342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:25.284783 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:25.287557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:25.287557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:25.288050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7454e7ab-d18e-4366-8316-3cdb5b346172 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:25.288655 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7454e7ab-d18e-4366-8316-3cdb5b346172 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:25.295217 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7454e7ab-d18e-4366-8316-3cdb5b346172 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:25.295660 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7454e7ab-d18e-4366-8316-3cdb5b346172 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:25.296416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7454e7ab-d18e-4366-8316-3cdb5b346172 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:25.296846 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7454e7ab-d18e-4366-8316-3cdb5b346172 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:25.300166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 HTTP/1.1 Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:11:25.301788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:11:25.303386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '27ec2434-e40b-47fc-b565-d465e3fe0f79'} Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:11:25.304370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:11:25.305781 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.307235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:11:25.307235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b1deebd0-69f4-41da-8284-a8d53493aeb6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 404 len: 111 microversion: 2.1 time: 0.029965 Jun 22 09:11:25.307235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 278/544] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:25 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:11:25.312477 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0bea32dd-30cd-45be-b295-1c2daeeb6eae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '.version_select at 0x7f500e3bfe50>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:25.325209 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:25.387433 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0bea32dd-30cd-45be-b295-1c2daeeb6eae tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472394792" status: 202 len: 0 microversion: 2.1 time: 0.074865 Jun 22 09:11:25.387433 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 279/545] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 22 09:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472394792 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:11:25.467185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7454e7ab-d18e-4366-8316-3cdb5b346172 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:25.475256 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7454e7ab-d18e-4366-8316-3cdb5b346172 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.190901 Jun 22 09:11:25.475834 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 267/546] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:25 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:25.916684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:25.917299 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] [instance: 8f9ac4e6-8316-4cc4-b764-ee64344dffe0] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:25.924434 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:25.927324 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:25.927324 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:25.927324 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:25.939295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] HTTP exception thrown: Instance 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 could not be found. Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Request method failure captured: Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 HTTP/1.1 Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistv-ls92isicHLVacwXd2ScCwyK9y8OJflgN5zMh-23b2AW00M9IfeDhNN8LK87FFHcDUkB-8DyWXCHvLWQLKHP7qPk7VQpfgqkWh9_7ChC7KEE87qEbyIzeHDjbHrhC7m2-tCIiqv3v2a7kaWZ0B4aYZnqH4_hUGq06Gj9R2IK5zAo Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 05bd1375c6784f58a77c9b508ff282c9 Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesSnapshotTestJSON-948784587 Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:11:25.940825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/05bd1375c6784f58a77c9b508ff282c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_05bd1375c6784f58a77c9b508ff282c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/05bd1375c6784f58a77c9b508ff282c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/05bd1375c6784f58a77c9b508ff282c9"}]}] Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesSnapshotTestJSON-948784587 Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 05bd1375c6784f58a77c9b508ff282c9 Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-948784587 Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesSnapshotTestJSON-948784587-project Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 4468a51c478d4fd38f2bc3066dff63ff Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesSnapshotTestJSON-948784587-project Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 could not be found. Jun 22 09:11:25.942296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '8f9ac4e6-8316-4cc4-b764-ee64344dffe0'} Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 could not be found. Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:11:25.943053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 could not be found. Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 could not be found. Jun 22 09:11:25.944327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:11:25.955521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] Returning 404 to user: Instance 8f9ac4e6-8316-4cc4-b764-ee64344dffe0 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:11:25.955521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-17b440c3-05d0-45c5-b0f7-979b8c9125e6 tempest-VolumesSnapshotTestJSON-948784587 tempest-VolumesSnapshotTestJSON-948784587-project] 10.222.0.55 "GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0" status: 404 len: 111 microversion: 2.1 time: 0.029794 Jun 22 09:11:25.955521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 280/547] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:25 2022] GET /compute/v2.1/servers/8f9ac4e6-8316-4cc4-b764-ee64344dffe0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:11:26.090081 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:26.090677 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:26.098238 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:26.098814 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:26.099717 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:26.100156 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:26.168702 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6d46e921-0f23-45cd-873a-9301959f3090 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:26.169214 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6d46e921-0f23-45cd-873a-9301959f3090 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:26.175980 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d46e921-0f23-45cd-873a-9301959f3090 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:26.176423 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d46e921-0f23-45cd-873a-9301959f3090 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:26.177184 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d46e921-0f23-45cd-873a-9301959f3090 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:26.177605 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6d46e921-0f23-45cd-873a-9301959f3090 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:26.246709 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:26.257352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:26.259014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:26.260185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bac4346d-d534-4295-adc8-bfb8eb0cf642 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.174085 Jun 22 09:11:26.260747 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 268/548] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:26 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:26.275883 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-6d46e921-0f23-45cd-873a-9301959f3090 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'services' on Instance uuid 139fc621-9e20-4f05-9935-92b048cc48a1 {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:11:26.493273 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bfe913d4-2f63-4d16-9da2-1a85637848cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:26.493831 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bfe913d4-2f63-4d16-9da2-1a85637848cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:26.501094 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bfe913d4-2f63-4d16-9da2-1a85637848cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:26.501330 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6d46e921-0f23-45cd-873a-9301959f3090 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments/e0718f0e-d9df-4b45-8e77-2bf2191b5563" status: 202 len: 0 microversion: 2.1 time: 0.336748 Jun 22 09:11:26.501548 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bfe913d4-2f63-4d16-9da2-1a85637848cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:26.501929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 281/549] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:11:26 2022] DELETE /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments/e0718f0e-d9df-4b45-8e77-2bf2191b5563 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:11:26.502434 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bfe913d4-2f63-4d16-9da2-1a85637848cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:26.502909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bfe913d4-2f63-4d16-9da2-1a85637848cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:26.511419 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8368d65f-574d-4c44-b123-7a0d1b016c8b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:26.512415 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8368d65f-574d-4c44-b123-7a0d1b016c8b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:26.519787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8368d65f-574d-4c44-b123-7a0d1b016c8b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:26.520229 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8368d65f-574d-4c44-b123-7a0d1b016c8b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:26.520989 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8368d65f-574d-4c44-b123-7a0d1b016c8b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:26.521628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8368d65f-574d-4c44-b123-7a0d1b016c8b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:26.568061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8368d65f-574d-4c44-b123-7a0d1b016c8b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060918 Jun 22 09:11:26.568885 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 282/550] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:11:26 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:11:26.666037 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bfe913d4-2f63-4d16-9da2-1a85637848cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:26.674551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bfe913d4-2f63-4d16-9da2-1a85637848cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.185344 Jun 22 09:11:26.675153 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 269/551] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:26 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:27.279121 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:27.279730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:27.286274 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:27.286722 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:27.287510 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:27.287945 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:27.421675 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:27.430087 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:27.431619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:27.432771 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a965177f-1863-4765-af85-8df319369c9e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.157670 Jun 22 09:11:27.433331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 283/552] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:27 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:27.581622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4c8d2778-3b77-42e6-a4de-423c210c9091 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:27.582668 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4c8d2778-3b77-42e6-a4de-423c210c9091 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:27.589406 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4c8d2778-3b77-42e6-a4de-423c210c9091 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:27.590789 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4c8d2778-3b77-42e6-a4de-423c210c9091 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:27.590789 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4c8d2778-3b77-42e6-a4de-423c210c9091 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:27.591818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4c8d2778-3b77-42e6-a4de-423c210c9091 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:27.630264 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4c8d2778-3b77-42e6-a4de-423c210c9091 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052930 Jun 22 09:11:27.630935 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 270/553] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:11:27 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:27.691957 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3a296157-c199-43bd-aa72-b70b45e8f854 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:27.692559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3a296157-c199-43bd-aa72-b70b45e8f854 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:27.698641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3a296157-c199-43bd-aa72-b70b45e8f854 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:27.699835 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3a296157-c199-43bd-aa72-b70b45e8f854 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:27.699946 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3a296157-c199-43bd-aa72-b70b45e8f854 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:27.700333 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3a296157-c199-43bd-aa72-b70b45e8f854 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:27.723677 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-4bd9cae9-0d60-420c-b530-5f6e221edec5 req-25cfd027-f743-4fb0-bf30-dcc60fc78237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c02245-d347-4fe2-8836-ca64aeb90e74", "name": "network-vif-plugged", "status": "completed", "tag": "5897603a-c758-4aef-b13d-a1bcac6199a0"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:27.732425 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-4bd9cae9-0d60-420c-b530-5f6e221edec5 req-25cfd027-f743-4fb0-bf30-dcc60fc78237 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:27.732936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-4bd9cae9-0d60-420c-b530-5f6e221edec5 req-25cfd027-f743-4fb0-bf30-dcc60fc78237 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:27.744514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-4bd9cae9-0d60-420c-b530-5f6e221edec5 req-25cfd027-f743-4fb0-bf30-dcc60fc78237 service nova] Creating event network-vif-plugged:5897603a-c758-4aef-b13d-a1bcac6199a0 for instance 04c02245-d347-4fe2-8836-ca64aeb90e74 on hv-cinder-80382 Jun 22 09:11:27.750690 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-4bd9cae9-0d60-420c-b530-5f6e221edec5 req-25cfd027-f743-4fb0-bf30-dcc60fc78237 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030558 Jun 22 09:11:27.751474 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 271/554] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:27.861104 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-3a296157-c199-43bd-aa72-b70b45e8f854 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:27.870089 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3a296157-c199-43bd-aa72-b70b45e8f854 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.181923 Jun 22 09:11:27.881928 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 284/555] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:27 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:28.453579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:28.454271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:28.460779 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:28.461336 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:28.462086 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:28.462514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:28.594086 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:28.602585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:28.605151 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:28.605280 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c8a82ef0-a6d7-40ce-8aee-d09289ae8da4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.156402 Jun 22 09:11:28.605807 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 272/556] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:28 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:28.641587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-94f5c7f4-cdcb-4199-b623-ebb0ba2eb0e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:28.642529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-94f5c7f4-cdcb-4199-b623-ebb0ba2eb0e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:28.649136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-94f5c7f4-cdcb-4199-b623-ebb0ba2eb0e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:28.649612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-94f5c7f4-cdcb-4199-b623-ebb0ba2eb0e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:28.650366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-94f5c7f4-cdcb-4199-b623-ebb0ba2eb0e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:28.650794 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-94f5c7f4-cdcb-4199-b623-ebb0ba2eb0e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:28.681951 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-94f5c7f4-cdcb-4199-b623-ebb0ba2eb0e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044412 Jun 22 09:11:28.682516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 285/557] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:11:28 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:11:28.737912 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cb853f18-3c75-41b3-ae6c-89d66f8fe4c7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:28.738397 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cb853f18-3c75-41b3-ae6c-89d66f8fe4c7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:28.744239 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb853f18-3c75-41b3-ae6c-89d66f8fe4c7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:28.744679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb853f18-3c75-41b3-ae6c-89d66f8fe4c7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:28.745420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb853f18-3c75-41b3-ae6c-89d66f8fe4c7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:28.745848 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb853f18-3c75-41b3-ae6c-89d66f8fe4c7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:28.763222 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=100 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:28.770149 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cb853f18-3c75-41b3-ae6c-89d66f8fe4c7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:11:28.888975 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-419ca107-4c6d-4971-9840-486f5dea318c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:28.889575 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-419ca107-4c6d-4971-9840-486f5dea318c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:28.895800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-419ca107-4c6d-4971-9840-486f5dea318c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:28.896193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-419ca107-4c6d-4971-9840-486f5dea318c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:28.896943 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-419ca107-4c6d-4971-9840-486f5dea318c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:28.897375 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-419ca107-4c6d-4971-9840-486f5dea318c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:29.009956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cb853f18-3c75-41b3-ae6c-89d66f8fe4c7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 204 len: 0 microversion: 2.1 time: 0.275462 Jun 22 09:11:29.010546 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 273/558] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:11:28 2022] DELETE /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:11:29.019416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-40dfb1f7-c5e2-4069-b412-3cbc6bc94d4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:29.020103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-40dfb1f7-c5e2-4069-b412-3cbc6bc94d4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:29.025985 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-40dfb1f7-c5e2-4069-b412-3cbc6bc94d4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:29.027562 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-40dfb1f7-c5e2-4069-b412-3cbc6bc94d4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:29.027562 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-40dfb1f7-c5e2-4069-b412-3cbc6bc94d4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:29.027887 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-40dfb1f7-c5e2-4069-b412-3cbc6bc94d4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:29.030458 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-419ca107-4c6d-4971-9840-486f5dea318c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:29.038436 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-419ca107-4c6d-4971-9840-486f5dea318c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.154102 Jun 22 09:11:29.039044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 286/559] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:28 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:29.163096 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-40dfb1f7-c5e2-4069-b412-3cbc6bc94d4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:29.171482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-40dfb1f7-c5e2-4069-b412-3cbc6bc94d4a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1681 microversion: 2.1 time: 0.156221 Jun 22 09:11:29.172039 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 274/560] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:29 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:29.624478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:29.625095 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:29.631389 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:29.631833 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:29.632788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:29.633105 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:29.764852 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:29.773183 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:29.774673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:29.775846 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7fc708bc-d105-4557-be56-5a4c1429db8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.155520 Jun 22 09:11:29.776408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 287/561] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:29 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:30.055675 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f1bf2eb5-f294-48c4-988a-5a9ea953b799 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:30.056248 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f1bf2eb5-f294-48c4-988a-5a9ea953b799 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:30.063443 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1bf2eb5-f294-48c4-988a-5a9ea953b799 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:30.063889 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1bf2eb5-f294-48c4-988a-5a9ea953b799 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:30.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1bf2eb5-f294-48c4-988a-5a9ea953b799 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:30.065099 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f1bf2eb5-f294-48c4-988a-5a9ea953b799 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:30.189776 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-892d4047-7361-4efb-ae96-26341deb6450 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:30.190453 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-892d4047-7361-4efb-ae96-26341deb6450 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:30.194462 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f1bf2eb5-f294-48c4-988a-5a9ea953b799 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:30.196364 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-892d4047-7361-4efb-ae96-26341deb6450 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:30.196811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-892d4047-7361-4efb-ae96-26341deb6450 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:30.197581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-892d4047-7361-4efb-ae96-26341deb6450 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:30.198018 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-892d4047-7361-4efb-ae96-26341deb6450 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:30.203273 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f1bf2eb5-f294-48c4-988a-5a9ea953b799 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.151425 Jun 22 09:11:30.203832 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 275/562] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:30 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:30.330467 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-892d4047-7361-4efb-ae96-26341deb6450 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:30.334139 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:30.338614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-892d4047-7361-4efb-ae96-26341deb6450 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1681 microversion: 2.1 time: 0.153620 Jun 22 09:11:30.339221 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 288/563] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:30 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:30.793429 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:30.794068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:30.800296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:30.800745 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:30.801501 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:30.801937 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:30.936024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:30.944487 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:30.946058 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:30.947242 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-72bed00d-ea86-4fc4-a740-8736944915dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.157659 Jun 22 09:11:30.947805 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 276/564] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:30 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:31.220928 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-166ede90-826d-4096-af11-76a301c1b4cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:31.221528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-166ede90-826d-4096-af11-76a301c1b4cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:31.228694 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-166ede90-826d-4096-af11-76a301c1b4cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:31.229131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-166ede90-826d-4096-af11-76a301c1b4cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:31.229874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-166ede90-826d-4096-af11-76a301c1b4cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:31.230299 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-166ede90-826d-4096-af11-76a301c1b4cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:31.361520 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-166ede90-826d-4096-af11-76a301c1b4cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:31.363677 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bebefdac-318c-4ccd-ba0f-6774dacf94dd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:31.364277 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bebefdac-318c-4ccd-ba0f-6774dacf94dd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:31.369870 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-166ede90-826d-4096-af11-76a301c1b4cf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.153686 Jun 22 09:11:31.370284 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bebefdac-318c-4ccd-ba0f-6774dacf94dd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:31.370434 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 289/565] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:31 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:31.370725 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bebefdac-318c-4ccd-ba0f-6774dacf94dd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:31.371582 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bebefdac-318c-4ccd-ba0f-6774dacf94dd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:31.372013 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bebefdac-318c-4ccd-ba0f-6774dacf94dd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:31.503118 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bebefdac-318c-4ccd-ba0f-6774dacf94dd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:31.510460 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bebefdac-318c-4ccd-ba0f-6774dacf94dd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1681 microversion: 2.1 time: 0.150449 Jun 22 09:11:31.511059 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 277/566] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:31 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:31.965841 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:31.966474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:32.008737 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:32.008737 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:32.008737 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:32.008737 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:32.139865 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:32.148189 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:32.149778 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:32.150948 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ad190074-4f6a-4222-a732-167a9f495070 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.189148 Jun 22 09:11:32.151535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 290/567] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:31 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:32.387346 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7306a23f-2e29-4ef5-8931-d0cad398c521 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:32.387941 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7306a23f-2e29-4ef5-8931-d0cad398c521 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:32.394635 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7306a23f-2e29-4ef5-8931-d0cad398c521 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:32.395111 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7306a23f-2e29-4ef5-8931-d0cad398c521 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:32.395859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7306a23f-2e29-4ef5-8931-d0cad398c521 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:32.396287 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7306a23f-2e29-4ef5-8931-d0cad398c521 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:32.529099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-76c4f791-62bc-4030-a6b7-3d55467d9a72 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:32.529709 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-76c4f791-62bc-4030-a6b7-3d55467d9a72 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:32.536580 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76c4f791-62bc-4030-a6b7-3d55467d9a72 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:32.537026 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76c4f791-62bc-4030-a6b7-3d55467d9a72 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:32.537780 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76c4f791-62bc-4030-a6b7-3d55467d9a72 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:32.538210 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76c4f791-62bc-4030-a6b7-3d55467d9a72 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:32.561363 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7306a23f-2e29-4ef5-8931-d0cad398c521 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:32.569477 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7306a23f-2e29-4ef5-8931-d0cad398c521 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.185904 Jun 22 09:11:32.573582 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 278/568] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:32 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:32.676561 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-76c4f791-62bc-4030-a6b7-3d55467d9a72 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:32.684410 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-76c4f791-62bc-4030-a6b7-3d55467d9a72 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1681 microversion: 2.1 time: 0.159822 Jun 22 09:11:32.691190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 291/569] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:32 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:33.169516 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:33.170036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:33.176010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:33.176453 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:33.177197 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:33.177623 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:33.304050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:33.313157 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:33.314653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:33.315829 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e8b9eeb8-09d7-4075-825d-c45421e40892 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.150498 Jun 22 09:11:33.316388 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 279/570] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:33 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:33.587746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fa2c3756-ba7d-4547-bb96-a4e2c8aa003a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:33.588538 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-fa2c3756-ba7d-4547-bb96-a4e2c8aa003a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:33.595104 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fa2c3756-ba7d-4547-bb96-a4e2c8aa003a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:33.595553 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fa2c3756-ba7d-4547-bb96-a4e2c8aa003a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:33.596311 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fa2c3756-ba7d-4547-bb96-a4e2c8aa003a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:33.596741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fa2c3756-ba7d-4547-bb96-a4e2c8aa003a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:33.701705 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a1e6c018-ee02-42d3-a6e9-b3b4b297c8ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:33.702547 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a1e6c018-ee02-42d3-a6e9-b3b4b297c8ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:33.708777 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a1e6c018-ee02-42d3-a6e9-b3b4b297c8ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:33.709225 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a1e6c018-ee02-42d3-a6e9-b3b4b297c8ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:33.709990 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a1e6c018-ee02-42d3-a6e9-b3b4b297c8ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:33.710474 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a1e6c018-ee02-42d3-a6e9-b3b4b297c8ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:33.735373 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fa2c3756-ba7d-4547-bb96-a4e2c8aa003a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:33.744219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fa2c3756-ba7d-4547-bb96-a4e2c8aa003a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.160395 Jun 22 09:11:33.751886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 292/571] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:33 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:33.966115 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a1e6c018-ee02-42d3-a6e9-b3b4b297c8ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:33.969122 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a1e6c018-ee02-42d3-a6e9-b3b4b297c8ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1681 microversion: 2.1 time: 0.271436 Jun 22 09:11:33.969694 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 280/572] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:33 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:34.333911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:34.334521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:34.341002 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:34.341713 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:34.342205 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:34.342706 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:34.488177 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:34.500246 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:34.512655 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:34.515790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b8dcee87-e22a-4c91-9849-651f77d9a370 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.185591 Jun 22 09:11:34.519676 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 293/573] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:34 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:34.769750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8ca3bc38-23ee-4c27-9022-0114632b77ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:34.770360 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8ca3bc38-23ee-4c27-9022-0114632b77ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:34.770893 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-2898e110-6227-4edf-9e31-3a2dda451af5 req-f540096e-e1e9-4973-bb84-e41953527a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "139fc621-9e20-4f05-9935-92b048cc48a1", "name": "network-vif-deleted", "tag": "daa50036-a697-4fc0-8fc6-23a1965628ef"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:34.779143 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ca3bc38-23ee-4c27-9022-0114632b77ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:34.779525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ca3bc38-23ee-4c27-9022-0114632b77ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:34.780292 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ca3bc38-23ee-4c27-9022-0114632b77ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:34.780889 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ca3bc38-23ee-4c27-9022-0114632b77ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:34.785252 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-2898e110-6227-4edf-9e31-3a2dda451af5 req-f540096e-e1e9-4973-bb84-e41953527a1b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:34.785807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-2898e110-6227-4edf-9e31-3a2dda451af5 req-f540096e-e1e9-4973-bb84-e41953527a1b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:34.798516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-2898e110-6227-4edf-9e31-3a2dda451af5 req-f540096e-e1e9-4973-bb84-e41953527a1b service nova] Creating event network-vif-deleted:daa50036-a697-4fc0-8fc6-23a1965628ef for instance 139fc621-9e20-4f05-9935-92b048cc48a1 on hv-cinder-80382 Jun 22 09:11:34.804031 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-2898e110-6227-4edf-9e31-3a2dda451af5 req-f540096e-e1e9-4973-bb84-e41953527a1b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041962 Jun 22 09:11:34.804990 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 294/574] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:34.925275 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8ca3bc38-23ee-4c27-9022-0114632b77ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:34.935085 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8ca3bc38-23ee-4c27-9022-0114632b77ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.175823 Jun 22 09:11:34.935085 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 281/575] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:34 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:34.987568 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5d689859-0dcc-452f-b1d1-af0a41af4df1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:34.988715 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5d689859-0dcc-452f-b1d1-af0a41af4df1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:34.995527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5d689859-0dcc-452f-b1d1-af0a41af4df1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:34.996311 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5d689859-0dcc-452f-b1d1-af0a41af4df1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:34.997321 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5d689859-0dcc-452f-b1d1-af0a41af4df1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:34.997761 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5d689859-0dcc-452f-b1d1-af0a41af4df1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:35.065839 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5d689859-0dcc-452f-b1d1-af0a41af4df1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:35.072348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5d689859-0dcc-452f-b1d1-af0a41af4df1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 200 len: 1326 microversion: 2.1 time: 0.089070 Jun 22 09:11:35.072929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 295/576] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:34 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:35.539770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:35.540818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:35.549348 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:35.550135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:35.551147 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:35.551756 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:35.751202 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:35.760382 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:35.768379 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:35.770321 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ba92da10-65e4-4146-ac56-d79feea91006 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1808 microversion: 2.20 time: 0.235442 Jun 22 09:11:35.793729 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 282/577] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:35 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:35.951936 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d77b749e-75ed-41ec-a63d-4b3950b47467 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:35.952539 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d77b749e-75ed-41ec-a63d-4b3950b47467 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:35.963036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d77b749e-75ed-41ec-a63d-4b3950b47467 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:35.963036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d77b749e-75ed-41ec-a63d-4b3950b47467 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:35.963036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d77b749e-75ed-41ec-a63d-4b3950b47467 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:35.963036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d77b749e-75ed-41ec-a63d-4b3950b47467 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:36.089788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:36.090390 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:36.096477 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:36.096924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:36.097946 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:36.098451 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:36.103144 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d77b749e-75ed-41ec-a63d-4b3950b47467 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:36.113287 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:11:36.113480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d77b749e-75ed-41ec-a63d-4b3950b47467 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.165764 Jun 22 09:11:36.114027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 296/578] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:35 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 HTTP/1.1 Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:11:36.115658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:11:36.117001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '139fc621-9e20-4f05-9935-92b048cc48a1'} Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:11:36.117790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:11:36.124499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:36.126068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:11:36.126068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1dd047ce-302c-49a7-a983-503ea121a210 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 404 len: 111 microversion: 2.1 time: 0.031280 Jun 22 09:11:36.126068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 283/579] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:36 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:11:36.131122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-10117b37-0877-4edd-ad2e-bd64dbc23dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '.version_select at 0x7f500e38a9d0>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:36.268209 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-10117b37-0877-4edd-ad2e-bd64dbc23dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720572273" status: 202 len: 0 microversion: 2.1 time: 0.140963 Jun 22 09:11:36.268818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 297/580] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 22 09:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720572273 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:11:36.790464 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:36.797634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:36.802395 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:36.802864 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:36.803626 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:36.804055 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:36.944985 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:36.953426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:36.955223 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:36.956385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7163b165-731f-4b87-a6e9-5125da6a7004 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1795 microversion: 2.20 time: 0.170053 Jun 22 09:11:36.957383 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 284/581] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:11:36 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1795 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:11:37.030250 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5795e623-52bf-4bf4-874f-ebd109cbfaa4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: .version_select at 0x7f500e3bf790>, body: {"keypair": {"name": "tempest-keypair-1732233921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQDhrpxJP9X2dQ8P4j1t6bKbetBaeZ+TZiK7FESu857nPlHLgnf4GOAjO3R8utsCvPYQ6/XwcDyBKrC+Qn9qRCTgyxEPY1uW/gMpLKg7TQCz9Q605tlqEK9QkKY380o5w=="}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:37.051304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-5795e623-52bf-4bf4-874f-ebd109cbfaa4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'key_pairs'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:11:37.055130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-5795e623-52bf-4bf4-874f-ebd109cbfaa4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for user 0673a8903f56430f86f87b9447668300 and project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'key_pairs'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:11:37.131091 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-981a6837-434a-4d0a-a848-e9bdf454ad0e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:37.131694 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-981a6837-434a-4d0a-a848-e9bdf454ad0e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:37.137107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5795e623-52bf-4bf4-874f-ebd109cbfaa4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111009 Jun 22 09:11:37.137710 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 298/582] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:11:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:37.137982 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-981a6837-434a-4d0a-a848-e9bdf454ad0e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:37.138433 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-981a6837-434a-4d0a-a848-e9bdf454ad0e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:37.139211 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-981a6837-434a-4d0a-a848-e9bdf454ad0e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:37.139684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-981a6837-434a-4d0a-a848-e9bdf454ad0e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:37.268582 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-981a6837-434a-4d0a-a848-e9bdf454ad0e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:37.277085 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-981a6837-434a-4d0a-a848-e9bdf454ad0e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.149672 Jun 22 09:11:37.277609 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 285/583] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:37 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:38.293487 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7b3be4ef-74ac-423e-a5fc-23eea7b24c2f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:38.294093 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7b3be4ef-74ac-423e-a5fc-23eea7b24c2f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:38.301843 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b3be4ef-74ac-423e-a5fc-23eea7b24c2f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:38.302289 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b3be4ef-74ac-423e-a5fc-23eea7b24c2f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:38.303070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b3be4ef-74ac-423e-a5fc-23eea7b24c2f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:38.303502 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b3be4ef-74ac-423e-a5fc-23eea7b24c2f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:38.492563 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7b3be4ef-74ac-423e-a5fc-23eea7b24c2f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:38.502635 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7b3be4ef-74ac-423e-a5fc-23eea7b24c2f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.213001 Jun 22 09:11:38.503553 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 299/584] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:38 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:39.522409 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a658a90d-d739-4f07-bc1a-71cc56cb8333 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:39.523600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a658a90d-d739-4f07-bc1a-71cc56cb8333 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:39.530703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a658a90d-d739-4f07-bc1a-71cc56cb8333 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:39.531173 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a658a90d-d739-4f07-bc1a-71cc56cb8333 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:39.531922 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a658a90d-d739-4f07-bc1a-71cc56cb8333 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:39.532349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a658a90d-d739-4f07-bc1a-71cc56cb8333 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:39.545887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-946203485", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "feb2a623-753e-4717-8e5a-c83201989599"}], "security_groups": [{"name": "tempest-securitygroup--910166483"}], "key_name": "tempest-keypair-1732233921", "user_data": "}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:39.649130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] validate_networks() for [('feb2a623-753e-4717-8e5a-c83201989599', None, None, None, None, None)] {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:11:39.666231 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a658a90d-d739-4f07-bc1a-71cc56cb8333 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:39.674384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a658a90d-d739-4f07-bc1a-71cc56cb8333 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.155681 Jun 22 09:11:39.674971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 286/585] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:39 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:40.005945 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:11:40.006410 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:11:40.006845 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:11:40.007284 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:11:40.007694 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:11:40.017024 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:40.017470 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:40.018257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:40.018690 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:40.034691 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:11:40.038613 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for user 0673a8903f56430f86f87b9447668300 and project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:11:40.049838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:11:40.052099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:11:40.189740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d19d36af-0910-4c74-8b6e-54d6a807fc9f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.648043 Jun 22 09:11:40.190563 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 300/586] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:11:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 09:11:40.200651 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f57235f8-60ef-45b2-8a50-496d347b5014 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:40.201261 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f57235f8-60ef-45b2-8a50-496d347b5014 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:40.256080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f57235f8-60ef-45b2-8a50-496d347b5014 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:40.262610 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f57235f8-60ef-45b2-8a50-496d347b5014 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1241 microversion: 2.1 time: 0.066157 Jun 22 09:11:40.263248 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 287/587] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:40 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:40.691980 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-332651f2-2254-45b1-a642-4d544417840e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:40.692587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-332651f2-2254-45b1-a642-4d544417840e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:40.699275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-332651f2-2254-45b1-a642-4d544417840e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:40.699728 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-332651f2-2254-45b1-a642-4d544417840e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:40.700492 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-332651f2-2254-45b1-a642-4d544417840e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:40.700944 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-332651f2-2254-45b1-a642-4d544417840e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:40.832964 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-332651f2-2254-45b1-a642-4d544417840e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:40.841048 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-332651f2-2254-45b1-a642-4d544417840e tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.153420 Jun 22 09:11:40.841621 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 301/588] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:40 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:41.280276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d6e94145-c8a4-4185-b0a6-3ec89e4a03ed tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:41.280857 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d6e94145-c8a4-4185-b0a6-3ec89e4a03ed tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:41.283484 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:41.289077 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6e94145-c8a4-4185-b0a6-3ec89e4a03ed tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:41.290406 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6e94145-c8a4-4185-b0a6-3ec89e4a03ed tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:41.290406 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6e94145-c8a4-4185-b0a6-3ec89e4a03ed tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:41.290717 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6e94145-c8a4-4185-b0a6-3ec89e4a03ed tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:41.352895 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d6e94145-c8a4-4185-b0a6-3ec89e4a03ed tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:41.362323 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d6e94145-c8a4-4185-b0a6-3ec89e4a03ed tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1245 microversion: 2.1 time: 0.086499 Jun 22 09:11:41.362923 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 288/589] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:41 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:41.857812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-369d639d-c0bc-4ff4-a68e-911d6285e2c9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:41.858437 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-369d639d-c0bc-4ff4-a68e-911d6285e2c9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:41.864861 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-369d639d-c0bc-4ff4-a68e-911d6285e2c9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:41.865302 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-369d639d-c0bc-4ff4-a68e-911d6285e2c9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:41.866045 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-369d639d-c0bc-4ff4-a68e-911d6285e2c9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:41.866514 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-369d639d-c0bc-4ff4-a68e-911d6285e2c9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:41.996442 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-369d639d-c0bc-4ff4-a68e-911d6285e2c9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:42.004955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-369d639d-c0bc-4ff4-a68e-911d6285e2c9 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.151154 Jun 22 09:11:42.005534 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 302/590] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:41 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:42.379336 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ef88ff92-cd17-4643-afe3-e7178c3bc3aa tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:42.380513 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ef88ff92-cd17-4643-afe3-e7178c3bc3aa tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:42.388294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef88ff92-cd17-4643-afe3-e7178c3bc3aa tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:42.388753 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef88ff92-cd17-4643-afe3-e7178c3bc3aa tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:42.389823 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef88ff92-cd17-4643-afe3-e7178c3bc3aa tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:42.390377 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ef88ff92-cd17-4643-afe3-e7178c3bc3aa tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:42.475917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ef88ff92-cd17-4643-afe3-e7178c3bc3aa tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:42.489259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ef88ff92-cd17-4643-afe3-e7178c3bc3aa tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1237 microversion: 2.1 time: 0.108959 Jun 22 09:11:42.489259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 289/591] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:42 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:43.021816 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bb9a6b86-5434-4fb3-8046-2f09b06b0655 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:43.022426 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bb9a6b86-5434-4fb3-8046-2f09b06b0655 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:43.029814 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bb9a6b86-5434-4fb3-8046-2f09b06b0655 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:43.030300 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bb9a6b86-5434-4fb3-8046-2f09b06b0655 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:43.031144 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bb9a6b86-5434-4fb3-8046-2f09b06b0655 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:43.031581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bb9a6b86-5434-4fb3-8046-2f09b06b0655 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:43.162443 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bb9a6b86-5434-4fb3-8046-2f09b06b0655 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:43.170880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bb9a6b86-5434-4fb3-8046-2f09b06b0655 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1732 microversion: 2.1 time: 0.153079 Jun 22 09:11:43.171445 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 303/592] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:43 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:43.504415 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a2647cc6-348e-4e73-b620-3cfea45ed984 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:43.505042 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a2647cc6-348e-4e73-b620-3cfea45ed984 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:43.511578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a2647cc6-348e-4e73-b620-3cfea45ed984 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:43.512027 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a2647cc6-348e-4e73-b620-3cfea45ed984 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:43.512790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a2647cc6-348e-4e73-b620-3cfea45ed984 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:43.513230 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a2647cc6-348e-4e73-b620-3cfea45ed984 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:43.517105 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:43.578117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a2647cc6-348e-4e73-b620-3cfea45ed984 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:43.585702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a2647cc6-348e-4e73-b620-3cfea45ed984 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1293 microversion: 2.1 time: 0.085192 Jun 22 09:11:43.586320 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 290/593] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:43 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:44.188452 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2f8e81f8-e948-4307-872f-391f7405234c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:44.189082 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2f8e81f8-e948-4307-872f-391f7405234c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:44.195976 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2f8e81f8-e948-4307-872f-391f7405234c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.196416 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2f8e81f8-e948-4307-872f-391f7405234c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.197172 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2f8e81f8-e948-4307-872f-391f7405234c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.197600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2f8e81f8-e948-4307-872f-391f7405234c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.330913 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2f8e81f8-e948-4307-872f-391f7405234c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:44.341455 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2f8e81f8-e948-4307-872f-391f7405234c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1712 microversion: 2.1 time: 0.156826 Jun 22 09:11:44.342244 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 304/594] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:44 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:44.457049 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:44.457872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:44.464001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.464532 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.465359 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.466421 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.566064 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] HTTP exception thrown: Cannot 'detach_volume' instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 while it is in vm_state rescued Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Request method failure captured: Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments/82610842-de93-4bec-a747-3119d9805aba HTTP/1.1 Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvHffkrcURPh5_p8DJ-OorG_jbpSa-9p7eRx2v0zUADKz4LoPZtA5Q_L-q42DvwL6rJ9BAkjazfPS3Q0VCpFJjRznzp8sl5hkv1cyTFXp8TvntWMEfIgtZqeRDBE9-1QqNO_TS597PJxaXTlyTT82OW19HSLE8KvEstAKAWo3BcBBM Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:11:44.567736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}] Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 71ac6423996b4e5d906de9ff6986fb03 Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:11:44.577773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Cannot 'detach_volume' instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 while it is in vm_state rescued Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'server_id': '6e593a5f-2134-4ca1-95b8-5f2e454dca54', 'id': '82610842-de93-4bec-a747-3119d9805aba'} Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:11:44.578986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 while it is in vm_state rescued Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 while it is in vm_state rescued Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:11:44.580221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Returning 409 to user: Cannot 'detach_volume' instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 while it is in vm_state rescued {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:11:44.581207 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2d0bf666-04e1-4e50-88f3-8c0dbf654b20 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments/82610842-de93-4bec-a747-3119d9805aba" status: 409 len: 152 microversion: 2.1 time: 0.116488 Jun 22 09:11:44.581207 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 291/595] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:11:44 2022] DELETE /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments/82610842-de93-4bec-a747-3119d9805aba => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 09:11:44.581366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9fc677e7-4a90-4b16-81d1-782728eb50fa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:44.581366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9fc677e7-4a90-4b16-81d1-782728eb50fa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:44.585246 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9fc677e7-4a90-4b16-81d1-782728eb50fa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.585689 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9fc677e7-4a90-4b16-81d1-782728eb50fa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.586440 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9fc677e7-4a90-4b16-81d1-782728eb50fa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.586890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9fc677e7-4a90-4b16-81d1-782728eb50fa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.608018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3895507f-3b4d-45d2-9dc0-b553c1d5e956 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:44.608715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3895507f-3b4d-45d2-9dc0-b553c1d5e956 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:44.615086 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3895507f-3b4d-45d2-9dc0-b553c1d5e956 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.617689 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3895507f-3b4d-45d2-9dc0-b553c1d5e956 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.617689 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3895507f-3b4d-45d2-9dc0-b553c1d5e956 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.617689 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3895507f-3b4d-45d2-9dc0-b553c1d5e956 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.700183 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3895507f-3b4d-45d2-9dc0-b553c1d5e956 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:44.708293 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3895507f-3b4d-45d2-9dc0-b553c1d5e956 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1301 microversion: 2.1 time: 0.105229 Jun 22 09:11:44.708863 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 292/596] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:44 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1301 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:44.796509 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9fc677e7-4a90-4b16-81d1-782728eb50fa tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "POST /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/action" status: 202 len: 0 microversion: 2.1 time: 0.222214 Jun 22 09:11:44.800251 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 305/597] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:11:44 2022] POST /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:11:44.805494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4fd6b6b5-552f-43fc-aeba-7570bb295d6b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:44.806106 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4fd6b6b5-552f-43fc-aeba-7570bb295d6b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:44.812793 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4fd6b6b5-552f-43fc-aeba-7570bb295d6b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.813297 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4fd6b6b5-552f-43fc-aeba-7570bb295d6b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.814073 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4fd6b6b5-552f-43fc-aeba-7570bb295d6b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.815016 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4fd6b6b5-552f-43fc-aeba-7570bb295d6b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:45.052713 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4fd6b6b5-552f-43fc-aeba-7570bb295d6b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:45.061208 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4fd6b6b5-552f-43fc-aeba-7570bb295d6b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1720 microversion: 2.1 time: 0.259588 Jun 22 09:11:45.061782 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 293/598] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:44 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:45.728377 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c62ec89b-4700-4947-9227-3439905e70b4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:45.729168 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c62ec89b-4700-4947-9227-3439905e70b4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:45.738568 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c62ec89b-4700-4947-9227-3439905e70b4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:45.739332 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c62ec89b-4700-4947-9227-3439905e70b4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:45.740408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c62ec89b-4700-4947-9227-3439905e70b4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:45.741111 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c62ec89b-4700-4947-9227-3439905e70b4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:45.897064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c62ec89b-4700-4947-9227-3439905e70b4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:45.904895 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c62ec89b-4700-4947-9227-3439905e70b4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.183117 Jun 22 09:11:45.905462 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 306/599] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:45 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:46.079451 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4a94afa4-a92e-4e8d-b256-48a5d23714e7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:46.079961 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4a94afa4-a92e-4e8d-b256-48a5d23714e7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:46.086455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4a94afa4-a92e-4e8d-b256-48a5d23714e7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:46.086929 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4a94afa4-a92e-4e8d-b256-48a5d23714e7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:46.087687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4a94afa4-a92e-4e8d-b256-48a5d23714e7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:46.088117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4a94afa4-a92e-4e8d-b256-48a5d23714e7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:46.218033 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4a94afa4-a92e-4e8d-b256-48a5d23714e7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:46.225994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4a94afa4-a92e-4e8d-b256-48a5d23714e7 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1720 microversion: 2.1 time: 0.151113 Jun 22 09:11:46.226810 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 294/600] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:46 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:46.536579 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-7184c092-aeea-496a-ad46-43196383ddf5 req-02250c8e-f904-43a2-85da-dd597badd179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc86b4e-da76-47e9-9481-0297e22fb98e", "tag": "6740c88c-c40a-42ad-9c39-e0f77f8360d2"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:46.546721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-7184c092-aeea-496a-ad46-43196383ddf5 req-02250c8e-f904-43a2-85da-dd597badd179 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:46.547200 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-7184c092-aeea-496a-ad46-43196383ddf5 req-02250c8e-f904-43a2-85da-dd597badd179 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:46.558807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-7184c092-aeea-496a-ad46-43196383ddf5 req-02250c8e-f904-43a2-85da-dd597badd179 service nova] Creating event network-changed:6740c88c-c40a-42ad-9c39-e0f77f8360d2 for instance cfc86b4e-da76-47e9-9481-0297e22fb98e on hv-cinder-80382 Jun 22 09:11:46.564385 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-7184c092-aeea-496a-ad46-43196383ddf5 req-02250c8e-f904-43a2-85da-dd597badd179 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033498 Jun 22 09:11:46.566552 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 307/601] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:46.923866 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7334abc4-405c-42be-8706-a08b2ea3f8ad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:46.924473 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7334abc4-405c-42be-8706-a08b2ea3f8ad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:46.931148 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7334abc4-405c-42be-8706-a08b2ea3f8ad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:46.941957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7334abc4-405c-42be-8706-a08b2ea3f8ad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:46.941957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7334abc4-405c-42be-8706-a08b2ea3f8ad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:46.941957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7334abc4-405c-42be-8706-a08b2ea3f8ad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:47.067490 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7334abc4-405c-42be-8706-a08b2ea3f8ad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:47.074936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7334abc4-405c-42be-8706-a08b2ea3f8ad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.154861 Jun 22 09:11:47.075563 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 295/602] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:46 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:47.244932 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e6d2c2cb-d704-4952-9b60-63c7581c4e5f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:47.245584 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e6d2c2cb-d704-4952-9b60-63c7581c4e5f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:47.252439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e6d2c2cb-d704-4952-9b60-63c7581c4e5f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:47.252895 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e6d2c2cb-d704-4952-9b60-63c7581c4e5f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:47.253745 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e6d2c2cb-d704-4952-9b60-63c7581c4e5f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:47.254183 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e6d2c2cb-d704-4952-9b60-63c7581c4e5f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:47.272494 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:47.390670 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e6d2c2cb-d704-4952-9b60-63c7581c4e5f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:47.400105 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e6d2c2cb-d704-4952-9b60-63c7581c4e5f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1720 microversion: 2.1 time: 0.159158 Jun 22 09:11:47.400105 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 308/603] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:47 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:48.091659 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bb8259b7-02dd-44b7-a6eb-a3525f8f7c20 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:48.092264 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bb8259b7-02dd-44b7-a6eb-a3525f8f7c20 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:48.098657 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bb8259b7-02dd-44b7-a6eb-a3525f8f7c20 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:48.099133 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bb8259b7-02dd-44b7-a6eb-a3525f8f7c20 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.099886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bb8259b7-02dd-44b7-a6eb-a3525f8f7c20 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:48.100316 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bb8259b7-02dd-44b7-a6eb-a3525f8f7c20 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.234519 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bb8259b7-02dd-44b7-a6eb-a3525f8f7c20 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:48.243067 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bb8259b7-02dd-44b7-a6eb-a3525f8f7c20 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.155223 Jun 22 09:11:48.243630 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 296/604] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:48 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:48.416756 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2ff5502d-78ab-414a-a904-2f528f05cacf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:48.417356 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2ff5502d-78ab-414a-a904-2f528f05cacf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:48.425047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ff5502d-78ab-414a-a904-2f528f05cacf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:48.425543 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ff5502d-78ab-414a-a904-2f528f05cacf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.429241 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ff5502d-78ab-414a-a904-2f528f05cacf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:48.429241 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ff5502d-78ab-414a-a904-2f528f05cacf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.556083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2ff5502d-78ab-414a-a904-2f528f05cacf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:48.564854 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2ff5502d-78ab-414a-a904-2f528f05cacf tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1726 microversion: 2.1 time: 0.151885 Jun 22 09:11:48.566992 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 309/605] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:48 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:48.581646 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b96b613e-3013-415f-93f2-9cd8ce016e0c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:48.582136 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b96b613e-3013-415f-93f2-9cd8ce016e0c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:48.588573 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b96b613e-3013-415f-93f2-9cd8ce016e0c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:48.589355 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b96b613e-3013-415f-93f2-9cd8ce016e0c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.590117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b96b613e-3013-415f-93f2-9cd8ce016e0c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:48.590545 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b96b613e-3013-415f-93f2-9cd8ce016e0c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.695426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b96b613e-3013-415f-93f2-9cd8ce016e0c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117872 Jun 22 09:11:48.696096 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 297/606] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 22 09:11:48 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:49.260430 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b0fb5441-8486-40bd-9cb4-a44b880b6e8e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:49.261037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b0fb5441-8486-40bd-9cb4-a44b880b6e8e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:49.267633 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0fb5441-8486-40bd-9cb4-a44b880b6e8e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:49.268129 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0fb5441-8486-40bd-9cb4-a44b880b6e8e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:49.268841 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0fb5441-8486-40bd-9cb4-a44b880b6e8e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:49.269273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0fb5441-8486-40bd-9cb4-a44b880b6e8e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:49.477512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b0fb5441-8486-40bd-9cb4-a44b880b6e8e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:49.484901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b0fb5441-8486-40bd-9cb4-a44b880b6e8e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.228283 Jun 22 09:11:49.485543 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 310/607] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:49 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:49.712550 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-c0990487-2e71-4365-9987-b28f3f2c4fa4 req-3a1d0523-e80b-4359-8a94-9f640c3d6849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e593a5f-2134-4ca1-95b8-5f2e454dca54", "tag": "c3ed1249-4d90-4b41-b5b8-c3d483a0e086"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:49.722610 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c0990487-2e71-4365-9987-b28f3f2c4fa4 req-3a1d0523-e80b-4359-8a94-9f640c3d6849 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:49.722610 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c0990487-2e71-4365-9987-b28f3f2c4fa4 req-3a1d0523-e80b-4359-8a94-9f640c3d6849 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:49.733983 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-c0990487-2e71-4365-9987-b28f3f2c4fa4 req-3a1d0523-e80b-4359-8a94-9f640c3d6849 service nova] Creating event network-changed:c3ed1249-4d90-4b41-b5b8-c3d483a0e086 for instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 on hv-cinder-80382 Jun 22 09:11:49.739031 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-c0990487-2e71-4365-9987-b28f3f2c4fa4 req-3a1d0523-e80b-4359-8a94-9f640c3d6849 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030720 Jun 22 09:11:49.739621 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 298/608] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:50.501746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cee0235d-07da-43a1-9c39-c7c5ed0d3fa6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:50.502474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cee0235d-07da-43a1-9c39-c7c5ed0d3fa6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:50.504530 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:50.508516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=10 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:50.511720 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cee0235d-07da-43a1-9c39-c7c5ed0d3fa6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:50.512171 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cee0235d-07da-43a1-9c39-c7c5ed0d3fa6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:50.512958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cee0235d-07da-43a1-9c39-c7c5ed0d3fa6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:50.513390 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cee0235d-07da-43a1-9c39-c7c5ed0d3fa6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:50.649317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cee0235d-07da-43a1-9c39-c7c5ed0d3fa6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:50.657353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cee0235d-07da-43a1-9c39-c7c5ed0d3fa6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.159681 Jun 22 09:11:50.657913 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 311/609] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:50 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:51.671937 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:51.676582 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-dfe3fdcd-b7dd-462e-a49b-63c9e6d23f1c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:51.677292 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-dfe3fdcd-b7dd-462e-a49b-63c9e6d23f1c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:51.683279 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dfe3fdcd-b7dd-462e-a49b-63c9e6d23f1c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:51.686310 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dfe3fdcd-b7dd-462e-a49b-63c9e6d23f1c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:51.686310 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dfe3fdcd-b7dd-462e-a49b-63c9e6d23f1c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:51.686310 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dfe3fdcd-b7dd-462e-a49b-63c9e6d23f1c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:51.752900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-61f67aff-90a0-407a-a1d8-daf891ea35a9 req-088866e3-2c5f-421a-873e-f2e772290bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e593a5f-2134-4ca1-95b8-5f2e454dca54", "tag": "c3ed1249-4d90-4b41-b5b8-c3d483a0e086"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:51.761409 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-61f67aff-90a0-407a-a1d8-daf891ea35a9 req-088866e3-2c5f-421a-873e-f2e772290bfe service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:51.761921 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-61f67aff-90a0-407a-a1d8-daf891ea35a9 req-088866e3-2c5f-421a-873e-f2e772290bfe service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:51.774587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-61f67aff-90a0-407a-a1d8-daf891ea35a9 req-088866e3-2c5f-421a-873e-f2e772290bfe service nova] Creating event network-changed:c3ed1249-4d90-4b41-b5b8-c3d483a0e086 for instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 on hv-cinder-80382 Jun 22 09:11:51.779916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-61f67aff-90a0-407a-a1d8-daf891ea35a9 req-088866e3-2c5f-421a-873e-f2e772290bfe service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030736 Jun 22 09:11:51.780509 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 312/610] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:11:51.818248 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-dfe3fdcd-b7dd-462e-a49b-63c9e6d23f1c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:51.827416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-dfe3fdcd-b7dd-462e-a49b-63c9e6d23f1c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.154884 Jun 22 09:11:51.827416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 299/611] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:51 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:52.843922 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-678378aa-f4df-437a-8807-306e002eacf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:52.844623 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-678378aa-f4df-437a-8807-306e002eacf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:52.851084 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-678378aa-f4df-437a-8807-306e002eacf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:52.851796 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-678378aa-f4df-437a-8807-306e002eacf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:52.852576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-678378aa-f4df-437a-8807-306e002eacf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:52.853158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-678378aa-f4df-437a-8807-306e002eacf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:53.004076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-678378aa-f4df-437a-8807-306e002eacf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:53.012386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-678378aa-f4df-437a-8807-306e002eacf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.173958 Jun 22 09:11:53.013519 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 313/612] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:52 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:54.029343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3c304e97-e565-4177-bd70-0befe71948cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:54.030040 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3c304e97-e565-4177-bd70-0befe71948cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:54.036553 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c304e97-e565-4177-bd70-0befe71948cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:54.037074 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c304e97-e565-4177-bd70-0befe71948cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:54.037939 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c304e97-e565-4177-bd70-0befe71948cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:54.038443 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c304e97-e565-4177-bd70-0befe71948cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:54.167410 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3c304e97-e565-4177-bd70-0befe71948cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:54.175553 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3c304e97-e565-4177-bd70-0befe71948cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.150045 Jun 22 09:11:54.176121 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 300/613] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:54 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:54.847799 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-4df9a028-352d-4ba4-9c84-61b162a62283 req-bbb59d44-f5d4-49ef-823d-1e7fcd3be025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc86b4e-da76-47e9-9481-0297e22fb98e", "name": "network-vif-plugged", "status": "completed", "tag": "6740c88c-c40a-42ad-9c39-e0f77f8360d2"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:54.857179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-4df9a028-352d-4ba4-9c84-61b162a62283 req-bbb59d44-f5d4-49ef-823d-1e7fcd3be025 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:54.857642 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-4df9a028-352d-4ba4-9c84-61b162a62283 req-bbb59d44-f5d4-49ef-823d-1e7fcd3be025 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:54.868298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-4df9a028-352d-4ba4-9c84-61b162a62283 req-bbb59d44-f5d4-49ef-823d-1e7fcd3be025 service nova] Creating event network-vif-plugged:6740c88c-c40a-42ad-9c39-e0f77f8360d2 for instance cfc86b4e-da76-47e9-9481-0297e22fb98e on hv-cinder-80382 Jun 22 09:11:54.873062 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-4df9a028-352d-4ba4-9c84-61b162a62283 req-bbb59d44-f5d4-49ef-823d-1e7fcd3be025 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030111 Jun 22 09:11:54.873632 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 314/614] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:55.193071 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-829ec945-0ff6-402d-b769-9b6a888772b1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:55.194334 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-829ec945-0ff6-402d-b769-9b6a888772b1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:55.204011 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-829ec945-0ff6-402d-b769-9b6a888772b1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:55.204775 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-829ec945-0ff6-402d-b769-9b6a888772b1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:55.205700 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-829ec945-0ff6-402d-b769-9b6a888772b1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:55.206286 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-829ec945-0ff6-402d-b769-9b6a888772b1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:55.361352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-829ec945-0ff6-402d-b769-9b6a888772b1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:55.368751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-829ec945-0ff6-402d-b769-9b6a888772b1 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.179780 Jun 22 09:11:55.369253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 301/615] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:55 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:56.385733 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b100c8f7-3e26-4b86-86a7-642c303e8bef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:56.386535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b100c8f7-3e26-4b86-86a7-642c303e8bef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:56.389116 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:56.393987 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b100c8f7-3e26-4b86-86a7-642c303e8bef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:56.394439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b100c8f7-3e26-4b86-86a7-642c303e8bef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:56.395223 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b100c8f7-3e26-4b86-86a7-642c303e8bef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:56.395659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b100c8f7-3e26-4b86-86a7-642c303e8bef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:56.532166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b100c8f7-3e26-4b86-86a7-642c303e8bef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:56.540752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b100c8f7-3e26-4b86-86a7-642c303e8bef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.159395 Jun 22 09:11:56.543310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 315/616] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:56 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:57.558408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fdc0165e-3491-436a-aa76-61f3469271be tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:57.559044 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fdc0165e-3491-436a-aa76-61f3469271be tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:57.566196 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fdc0165e-3491-436a-aa76-61f3469271be tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:57.566883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fdc0165e-3491-436a-aa76-61f3469271be tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:57.567417 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fdc0165e-3491-436a-aa76-61f3469271be tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:57.567858 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fdc0165e-3491-436a-aa76-61f3469271be tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:57.699238 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fdc0165e-3491-436a-aa76-61f3469271be tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:57.707236 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fdc0165e-3491-436a-aa76-61f3469271be tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.152635 Jun 22 09:11:57.707795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 302/617] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:57 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:58.723586 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6544cde9-a030-4b14-9241-c413afbc0d7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:58.724187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6544cde9-a030-4b14-9241-c413afbc0d7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:58.732180 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6544cde9-a030-4b14-9241-c413afbc0d7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:58.732629 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6544cde9-a030-4b14-9241-c413afbc0d7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:58.733381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6544cde9-a030-4b14-9241-c413afbc0d7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:58.733811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6544cde9-a030-4b14-9241-c413afbc0d7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:58.859409 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6544cde9-a030-4b14-9241-c413afbc0d7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:58.866947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6544cde9-a030-4b14-9241-c413afbc0d7d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1366 microversion: 2.1 time: 0.147087 Jun 22 09:11:58.867456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 316/618] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:58 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:59.883715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5d08b03c-68db-4946-8bf1-79f915a8d89b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:59.884398 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5d08b03c-68db-4946-8bf1-79f915a8d89b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:59.891379 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d08b03c-68db-4946-8bf1-79f915a8d89b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:59.891821 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d08b03c-68db-4946-8bf1-79f915a8d89b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:59.892600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d08b03c-68db-4946-8bf1-79f915a8d89b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:59.893030 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d08b03c-68db-4946-8bf1-79f915a8d89b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:00.022027 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5d08b03c-68db-4946-8bf1-79f915a8d89b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:00.029411 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5d08b03c-68db-4946-8bf1-79f915a8d89b tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1556 microversion: 2.1 time: 0.150324 Jun 22 09:12:00.029972 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 303/619] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:59 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:00.045428 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7e202aef-ae25-4526-944a-2372c54b37eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:00.045909 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7e202aef-ae25-4526-944a-2372c54b37eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:00.052280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7e202aef-ae25-4526-944a-2372c54b37eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:00.052728 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7e202aef-ae25-4526-944a-2372c54b37eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:00.053480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7e202aef-ae25-4526-944a-2372c54b37eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:00.053915 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7e202aef-ae25-4526-944a-2372c54b37eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:00.131376 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7e202aef-ae25-4526-944a-2372c54b37eb tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089775 Jun 22 09:12:00.131971 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 317/620] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 22 09:12:00 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:01.339137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-db4df1ae-6a98-4f8a-91b3-a6c7183da8fa req-15f586fa-293a-4581-aa46-3afc30280dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc86b4e-da76-47e9-9481-0297e22fb98e", "tag": "6740c88c-c40a-42ad-9c39-e0f77f8360d2"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:01.351048 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-db4df1ae-6a98-4f8a-91b3-a6c7183da8fa req-15f586fa-293a-4581-aa46-3afc30280dad service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:01.351048 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-db4df1ae-6a98-4f8a-91b3-a6c7183da8fa req-15f586fa-293a-4581-aa46-3afc30280dad service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:01.364955 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-db4df1ae-6a98-4f8a-91b3-a6c7183da8fa req-15f586fa-293a-4581-aa46-3afc30280dad service nova] Creating event network-changed:6740c88c-c40a-42ad-9c39-e0f77f8360d2 for instance cfc86b4e-da76-47e9-9481-0297e22fb98e on hv-cinder-80382 Jun 22 09:12:01.366760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-db4df1ae-6a98-4f8a-91b3-a6c7183da8fa req-15f586fa-293a-4581-aa46-3afc30280dad service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031236 Jun 22 09:12:01.367420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 304/621] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:03.687897 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e585959e-0511-4da2-a013-8044973980b1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:03.688887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e585959e-0511-4da2-a013-8044973980b1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:03.694791 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e585959e-0511-4da2-a013-8044973980b1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:03.695268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e585959e-0511-4da2-a013-8044973980b1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:03.696018 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e585959e-0511-4da2-a013-8044973980b1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:03.696447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e585959e-0511-4da2-a013-8044973980b1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:03.725131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e585959e-0511-4da2-a013-8044973980b1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042428 Jun 22 09:12:03.725690 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 318/622] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:03 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 09:12:03.790160 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-19b88089-a8b3-4a5c-b51b-a0139fcd0e51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:03.790729 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-19b88089-a8b3-4a5c-b51b-a0139fcd0e51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:03.797554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-19b88089-a8b3-4a5c-b51b-a0139fcd0e51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:03.797995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-19b88089-a8b3-4a5c-b51b-a0139fcd0e51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:03.798741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-19b88089-a8b3-4a5c-b51b-a0139fcd0e51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:03.799199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-19b88089-a8b3-4a5c-b51b-a0139fcd0e51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:03.823641 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-19b88089-a8b3-4a5c-b51b-a0139fcd0e51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:12:04.112889 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-19b88089-a8b3-4a5c-b51b-a0139fcd0e51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 204 len: 0 microversion: 2.1 time: 0.327199 Jun 22 09:12:04.113494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 305/623] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:12:03 2022] DELETE /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:12:04.122027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3ec43570-6253-45f4-9290-cb9d1160cf65 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:04.122639 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3ec43570-6253-45f4-9290-cb9d1160cf65 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:04.128777 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3ec43570-6253-45f4-9290-cb9d1160cf65 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:04.129226 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3ec43570-6253-45f4-9290-cb9d1160cf65 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:04.130013 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3ec43570-6253-45f4-9290-cb9d1160cf65 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:04.130470 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3ec43570-6253-45f4-9290-cb9d1160cf65 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:04.259789 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-3ec43570-6253-45f4-9290-cb9d1160cf65 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:04.267714 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3ec43570-6253-45f4-9290-cb9d1160cf65 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1673 microversion: 2.1 time: 0.149904 Jun 22 09:12:04.270339 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 319/624] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:04 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:05.285692 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0f786a6f-8e21-45be-b30a-9b3431e3f1be tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:05.286430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0f786a6f-8e21-45be-b30a-9b3431e3f1be tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:05.292969 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f786a6f-8e21-45be-b30a-9b3431e3f1be tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:05.293417 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f786a6f-8e21-45be-b30a-9b3431e3f1be tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:05.294282 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f786a6f-8e21-45be-b30a-9b3431e3f1be tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:05.294713 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f786a6f-8e21-45be-b30a-9b3431e3f1be tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:05.484066 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-0f786a6f-8e21-45be-b30a-9b3431e3f1be tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:05.487684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:05.492186 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0f786a6f-8e21-45be-b30a-9b3431e3f1be tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1673 microversion: 2.1 time: 0.210772 Jun 22 09:12:05.492823 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 306/625] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:05 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:06.510045 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0b94403b-c465-499e-8d34-0efcbb7e4e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:06.511475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0b94403b-c465-499e-8d34-0efcbb7e4e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:06.518529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0b94403b-c465-499e-8d34-0efcbb7e4e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:06.519282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0b94403b-c465-499e-8d34-0efcbb7e4e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:06.520282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0b94403b-c465-499e-8d34-0efcbb7e4e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:06.521572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0b94403b-c465-499e-8d34-0efcbb7e4e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:06.797880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0b94403b-c465-499e-8d34-0efcbb7e4e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:06.803523 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0b94403b-c465-499e-8d34-0efcbb7e4e34 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1673 microversion: 2.1 time: 0.297863 Jun 22 09:12:06.813408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 320/626] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:06 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1673 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:07.821048 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9107e686-1e7c-4c2f-9d7a-99efafefc188 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:07.821802 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9107e686-1e7c-4c2f-9d7a-99efafefc188 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:07.833977 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9107e686-1e7c-4c2f-9d7a-99efafefc188 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:07.833977 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9107e686-1e7c-4c2f-9d7a-99efafefc188 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:07.833977 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9107e686-1e7c-4c2f-9d7a-99efafefc188 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:07.833977 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9107e686-1e7c-4c2f-9d7a-99efafefc188 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:08.029683 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9107e686-1e7c-4c2f-9d7a-99efafefc188 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:08.051705 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9107e686-1e7c-4c2f-9d7a-99efafefc188 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1605 microversion: 2.1 time: 0.234683 Jun 22 09:12:08.054946 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 307/627] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:07 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:08.161020 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-79a0ef78-7432-41b0-a271-735a809ff4d6 req-31329d92-da67-4c37-92b1-c2ff10fba5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a986f8d-3000-440e-b006-4c90b7c765fa", "name": "network-vif-deleted", "tag": "c0eb72f1-4dd3-41ec-bab1-7fb490daf290"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:08.172659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-79a0ef78-7432-41b0-a271-735a809ff4d6 req-31329d92-da67-4c37-92b1-c2ff10fba5f1 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:08.175564 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-79a0ef78-7432-41b0-a271-735a809ff4d6 req-31329d92-da67-4c37-92b1-c2ff10fba5f1 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:08.201389 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-79a0ef78-7432-41b0-a271-735a809ff4d6 req-31329d92-da67-4c37-92b1-c2ff10fba5f1 service nova] Creating event network-vif-deleted:c0eb72f1-4dd3-41ec-bab1-7fb490daf290 for instance 7a986f8d-3000-440e-b006-4c90b7c765fa on hv-cinder-80382 Jun 22 09:12:08.207385 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-79a0ef78-7432-41b0-a271-735a809ff4d6 req-31329d92-da67-4c37-92b1-c2ff10fba5f1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049980 Jun 22 09:12:08.208383 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 321/628] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:09.073314 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:09.073931 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:09.082663 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:09.082663 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:09.083929 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:09.084444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:09.122666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:09.123396 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:09.124178 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lazy-loading 'fault' on Instance uuid 7a986f8d-3000-440e-b006-4c90b7c765fa {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:12:09.182209 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:09.194962 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-91fd2ccc-c6e5-4d26-a495-c846b797764a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 200 len: 1326 microversion: 2.1 time: 0.127739 Jun 22 09:12:09.197238 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 308/629] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:09 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:10.216680 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:10.217479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:10.233709 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:10.237146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:10.238933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:10.239581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:10.258138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] HTTP exception thrown: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Request method failure captured: Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa HTTP/1.1 Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvEdjAdBsNtlgfW4nJWT5bu-if7_eyOtFX6pzrgxAk3jD5_Cw0McBWwKKzdk6pUwFB0yuDQEPbjoLMfXy2nOdkhAMLUqKew2SFjvxv7hLSAn_kjYDMDxmGgl8lZDC6ejUw8qSrRrB4PXlEDWOjC2BCzY--I6VPXhD7XN3WAZQ6dY0Y Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: b887d876b7624299b5575036da211d6b Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:12:10.261906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b887d876b7624299b5575036da211d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b887d876b7624299b5575036da211d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}] Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: b887d876b7624299b5575036da211d6b Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: abcbf501ca754212a16bbfbb901944f7 Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:12:10.264099 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '7a986f8d-3000-440e-b006-4c90b7c765fa'} Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:12:10.265057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:12:10.266578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:10.271595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Returning 404 to user: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:12:10.271595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-df59d007-e5a0-4395-89dc-266e3d70f31d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 404 len: 111 microversion: 2.1 time: 0.055403 Jun 22 09:12:10.271595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 322/630] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:10 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:12:10.278970 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ee749c9f-4920-4377-9068-e4d0933bc3f4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '.version_select at 0x7f500e30d550>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:10.354801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ee749c9f-4920-4377-9068-e4d0933bc3f4 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-949014270" status: 202 len: 0 microversion: 2.1 time: 0.081632 Jun 22 09:12:10.355605 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 309/631] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 22 09:12:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-949014270 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:12:11.234617 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-390d5c04-75b4-4315-a6ad-5af5983ea2ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'create', calling method: .version_select at 0x7f500e36fc10>, body: {"keypair": {"name": "tempest-keypair-1106250707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9FvDNAK8h7wVV23Gzx7BWu+eMffd7leZM8M29rdkXhwxaME/vsnglaHI4mG4jiiF8X7/4dGiHAHzYDQzd6tRZLBoIm7vYz77WerGa0QdTWAG4MScAlKUOV5op9f02+GQ=="}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:11.252394 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-390d5c04-75b4-4315-a6ad-5af5983ea2ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Getting quotas for project b887d876b7624299b5575036da211d6b. Resources: {'key_pairs'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:12:11.256479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-390d5c04-75b4-4315-a6ad-5af5983ea2ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Getting quotas for user abcbf501ca754212a16bbfbb901944f7 and project b887d876b7624299b5575036da211d6b. Resources: {'key_pairs'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:12:11.362312 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-390d5c04-75b4-4315-a6ad-5af5983ea2ad tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134399 Jun 22 09:12:11.363472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 323/632] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:12:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:13.742721 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-730585524", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afe5cf3e-c89f-4784-88a7-346190bc1b68"}], "security_groups": [{"name": "tempest-securitygroup--458312519"}], "key_name": "tempest-keypair-1106250707", "user_data": "}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:13.750746 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:14.029858 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] validate_networks() for [('afe5cf3e-c89f-4784-88a7-346190bc1b68', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:12:14.768891 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:12:14.770003 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:12:14.770631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:12:14.771267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:12:14.775066 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:12:14.781623 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:14.782075 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:14.782877 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:14.783492 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:14.812029 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Getting quotas for project b887d876b7624299b5575036da211d6b. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:12:14.816104 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Getting quotas for user abcbf501ca754212a16bbfbb901944f7 and project b887d876b7624299b5575036da211d6b. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:12:14.829147 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:12:14.831636 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:12:14.933687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-12c19db5-30f5-4d8d-8e15-3728a956f254 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.196442 Jun 22 09:12:14.935004 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 310/633] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:12:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:12:14.952937 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bbfacaf8-b7f9-4ae2-a215-b0f03b17b355 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:14.953546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bbfacaf8-b7f9-4ae2-a215-b0f03b17b355 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:15.051752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bbfacaf8-b7f9-4ae2-a215-b0f03b17b355 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:15.060180 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bbfacaf8-b7f9-4ae2-a215-b0f03b17b355 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1237 microversion: 2.1 time: 0.111657 Jun 22 09:12:15.060978 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 324/634] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:14 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1237 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:16.079008 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8447f5c9-4288-4431-86f1-bea3b34dfa83 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:16.079650 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8447f5c9-4288-4431-86f1-bea3b34dfa83 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:16.089779 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8447f5c9-4288-4431-86f1-bea3b34dfa83 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.090229 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8447f5c9-4288-4431-86f1-bea3b34dfa83 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.091065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8447f5c9-4288-4431-86f1-bea3b34dfa83 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.091653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8447f5c9-4288-4431-86f1-bea3b34dfa83 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.169734 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8447f5c9-4288-4431-86f1-bea3b34dfa83 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:16.177537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8447f5c9-4288-4431-86f1-bea3b34dfa83 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1241 microversion: 2.1 time: 0.104013 Jun 22 09:12:16.178309 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 311/635] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:16 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:16.268327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-823e21b5-969d-4503-8b4d-cd38d000fee4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:16.271962 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-823e21b5-969d-4503-8b4d-cd38d000fee4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:16.279714 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-823e21b5-969d-4503-8b4d-cd38d000fee4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.286123 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-823e21b5-969d-4503-8b4d-cd38d000fee4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.287284 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-823e21b5-969d-4503-8b4d-cd38d000fee4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.287898 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-823e21b5-969d-4503-8b4d-cd38d000fee4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.342534 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-823e21b5-969d-4503-8b4d-cd38d000fee4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments/96848c79-acfd-4160-bf0b-825ea5adc91b" status: 200 len: 194 microversion: 2.20 time: 0.067079 Jun 22 09:12:16.344637 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 325/636] 10.222.0.55 () {60 vars in 1453 bytes} [Wed Jun 22 09:12:16 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments/96848c79-acfd-4160-bf0b-825ea5adc91b => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:12:16.471370 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0f9d3454-1d09-4328-9dd8-e9952612b707 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:16.471865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0f9d3454-1d09-4328-9dd8-e9952612b707 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:16.480100 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f9d3454-1d09-4328-9dd8-e9952612b707 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.480545 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f9d3454-1d09-4328-9dd8-e9952612b707 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.481922 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f9d3454-1d09-4328-9dd8-e9952612b707 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.482679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0f9d3454-1d09-4328-9dd8-e9952612b707 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.589404 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-0f9d3454-1d09-4328-9dd8-e9952612b707 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lazy-loading 'services' on Instance uuid 04c02245-d347-4fe2-8836-ca64aeb90e74 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:12:16.792841 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0f9d3454-1d09-4328-9dd8-e9952612b707 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "DELETE /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments/96848c79-acfd-4160-bf0b-825ea5adc91b" status: 202 len: 0 microversion: 2.20 time: 0.326711 Jun 22 09:12:16.794796 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 312/637] 10.222.0.55 () {60 vars in 1456 bytes} [Wed Jun 22 09:12:16 2022] DELETE /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments/96848c79-acfd-4160-bf0b-825ea5adc91b => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:12:16.803959 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-687ae6af-e824-441d-88b8-1e77e8f2ce90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:16.805040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-687ae6af-e824-441d-88b8-1e77e8f2ce90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:16.815033 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-687ae6af-e824-441d-88b8-1e77e8f2ce90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.816422 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-687ae6af-e824-441d-88b8-1e77e8f2ce90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.816811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-687ae6af-e824-441d-88b8-1e77e8f2ce90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:16.817430 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-687ae6af-e824-441d-88b8-1e77e8f2ce90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:16.853643 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-687ae6af-e824-441d-88b8-1e77e8f2ce90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054343 Jun 22 09:12:16.854222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 326/638] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 22 09:12:16 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:12:17.197355 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5637102d-2e68-4e1d-843a-d59e57a3271a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:17.198063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5637102d-2e68-4e1d-843a-d59e57a3271a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:17.206680 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5637102d-2e68-4e1d-843a-d59e57a3271a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:17.207473 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5637102d-2e68-4e1d-843a-d59e57a3271a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:17.208312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5637102d-2e68-4e1d-843a-d59e57a3271a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:17.208743 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5637102d-2e68-4e1d-843a-d59e57a3271a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:17.298991 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5637102d-2e68-4e1d-843a-d59e57a3271a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:17.307675 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5637102d-2e68-4e1d-843a-d59e57a3271a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1289 microversion: 2.1 time: 0.115812 Jun 22 09:12:17.309775 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 313/639] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:17 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1289 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:17.866481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fe54e4a0-672f-4e64-bfb0-e64552396120 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:17.867972 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-fe54e4a0-672f-4e64-bfb0-e64552396120 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:17.878635 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fe54e4a0-672f-4e64-bfb0-e64552396120 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:17.884953 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fe54e4a0-672f-4e64-bfb0-e64552396120 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:17.885785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fe54e4a0-672f-4e64-bfb0-e64552396120 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:17.886227 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fe54e4a0-672f-4e64-bfb0-e64552396120 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:17.923470 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fe54e4a0-672f-4e64-bfb0-e64552396120 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060978 Jun 22 09:12:17.924961 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 327/640] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 22 09:12:17 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:12:18.326634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bff8524e-d4df-49c9-b307-97666e4d5578 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:18.328735 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bff8524e-d4df-49c9-b307-97666e4d5578 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:18.339712 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bff8524e-d4df-49c9-b307-97666e4d5578 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:18.359220 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bff8524e-d4df-49c9-b307-97666e4d5578 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:18.360960 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bff8524e-d4df-49c9-b307-97666e4d5578 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:18.362695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bff8524e-d4df-49c9-b307-97666e4d5578 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:18.465544 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bff8524e-d4df-49c9-b307-97666e4d5578 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:18.477472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bff8524e-d4df-49c9-b307-97666e4d5578 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1297 microversion: 2.1 time: 0.155506 Jun 22 09:12:18.478059 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 314/641] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:18 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1297 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:18.937085 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a1fadbb9-abf3-4145-b474-51cfadb6150e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:18.938098 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a1fadbb9-abf3-4145-b474-51cfadb6150e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:18.945004 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a1fadbb9-abf3-4145-b474-51cfadb6150e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:18.945709 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a1fadbb9-abf3-4145-b474-51cfadb6150e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:18.946478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a1fadbb9-abf3-4145-b474-51cfadb6150e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:18.946942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a1fadbb9-abf3-4145-b474-51cfadb6150e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:18.951861 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=87 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:18.978005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a1fadbb9-abf3-4145-b474-51cfadb6150e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045497 Jun 22 09:12:18.983773 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 328/642] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 22 09:12:18 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:19.046084 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-297e8de9-dafe-447a-b03a-d2c77e395d44 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:19.047083 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-297e8de9-dafe-447a-b03a-d2c77e395d44 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:19.053314 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-297e8de9-dafe-447a-b03a-d2c77e395d44 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:19.053876 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-297e8de9-dafe-447a-b03a-d2c77e395d44 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:19.056768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-297e8de9-dafe-447a-b03a-d2c77e395d44 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:19.056768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-297e8de9-dafe-447a-b03a-d2c77e395d44 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:19.085923 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-297e8de9-dafe-447a-b03a-d2c77e395d44 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:12:19.404809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-297e8de9-dafe-447a-b03a-d2c77e395d44 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "DELETE /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 204 len: 0 microversion: 2.20 time: 0.364232 Jun 22 09:12:19.406634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 315/643] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 22 09:12:19 2022] DELETE /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:12:19.424356 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:19.426481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:19.456572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:19.459065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:19.462121 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:19.464562 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:19.496346 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-87d69452-7489-4264-b6bb-9cec42324d68 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:19.497322 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-87d69452-7489-4264-b6bb-9cec42324d68 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:19.509318 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-87d69452-7489-4264-b6bb-9cec42324d68 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:19.511821 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-87d69452-7489-4264-b6bb-9cec42324d68 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:19.513164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-87d69452-7489-4264-b6bb-9cec42324d68 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:19.514194 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-87d69452-7489-4264-b6bb-9cec42324d68 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:19.717468 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:19.730177 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:19.732698 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:19.734331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c91e3173-37aa-490b-bcb4-8de9d8d29a21 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.322712 Jun 22 09:12:19.735449 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 329/644] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:19 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:19.936850 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-87d69452-7489-4264-b6bb-9cec42324d68 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:19.947141 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-87d69452-7489-4264-b6bb-9cec42324d68 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.454994 Jun 22 09:12:19.956707 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 316/645] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:19 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:20.581693 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-6f750461-a46e-4b5a-aebe-5a8a3d41cff9 req-4df7c9ed-c24f-46c9-a6d4-f86ff2090e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da52f0d-9679-4693-8b50-b3891b62b1c4", "tag": "0c0a5a8c-c11e-4b3a-bbae-bb0484acd5fe"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:20.592610 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-6f750461-a46e-4b5a-aebe-5a8a3d41cff9 req-4df7c9ed-c24f-46c9-a6d4-f86ff2090e7d service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:20.593055 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-6f750461-a46e-4b5a-aebe-5a8a3d41cff9 req-4df7c9ed-c24f-46c9-a6d4-f86ff2090e7d service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:20.612400 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-6f750461-a46e-4b5a-aebe-5a8a3d41cff9 req-4df7c9ed-c24f-46c9-a6d4-f86ff2090e7d service nova] Creating event network-changed:0c0a5a8c-c11e-4b3a-bbae-bb0484acd5fe for instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 on hv-cinder-80382 Jun 22 09:12:20.618421 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-6f750461-a46e-4b5a-aebe-5a8a3d41cff9 req-4df7c9ed-c24f-46c9-a6d4-f86ff2090e7d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040414 Jun 22 09:12:20.619277 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 330/646] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:20.754916 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:20.756232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:20.767695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:20.768538 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:20.769599 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:20.770198 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:20.964960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7c289d1e-01e1-4eff-b3f7-00de5a559028 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:20.966253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7c289d1e-01e1-4eff-b3f7-00de5a559028 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:20.982349 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7c289d1e-01e1-4eff-b3f7-00de5a559028 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:20.985379 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7c289d1e-01e1-4eff-b3f7-00de5a559028 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:20.986428 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7c289d1e-01e1-4eff-b3f7-00de5a559028 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:20.987712 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7c289d1e-01e1-4eff-b3f7-00de5a559028 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:21.094167 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:21.123304 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:21.125203 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:21.135009 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8b8a8170-7d34-403d-951f-d01e90b5384b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.384927 Jun 22 09:12:21.135925 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 317/647] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:20 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:21.178899 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7c289d1e-01e1-4eff-b3f7-00de5a559028 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:21.191500 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7c289d1e-01e1-4eff-b3f7-00de5a559028 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.230940 Jun 22 09:12:21.203603 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 331/648] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:20 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:22.156764 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:22.158334 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:22.167208 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:22.171299 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:22.172492 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:22.174352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:22.210592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b59d2e22-b3f5-429e-9064-5890dc2d8ff7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:22.213280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b59d2e22-b3f5-429e-9064-5890dc2d8ff7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:22.223933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b59d2e22-b3f5-429e-9064-5890dc2d8ff7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:22.239089 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b59d2e22-b3f5-429e-9064-5890dc2d8ff7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:22.242653 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b59d2e22-b3f5-429e-9064-5890dc2d8ff7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:22.245627 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b59d2e22-b3f5-429e-9064-5890dc2d8ff7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:22.471068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b59d2e22-b3f5-429e-9064-5890dc2d8ff7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:22.483440 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b59d2e22-b3f5-429e-9064-5890dc2d8ff7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.277670 Jun 22 09:12:22.484033 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 332/649] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:22 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:22.603397 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:22.614099 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:22.616035 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:22.617458 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-69ca310e-37df-4a45-bf51-2e484033e945 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1723 microversion: 2.20 time: 0.467980 Jun 22 09:12:22.618550 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 318/650] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:22 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:23.270567 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-d0ee21f8-8f45-4fea-81f5-aff4fd8dde15 req-8aa67506-46a4-45f9-951f-1e12a0290995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c02245-d347-4fe2-8836-ca64aeb90e74", "name": "network-vif-deleted", "tag": "5897603a-c758-4aef-b13d-a1bcac6199a0"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:23.287817 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-d0ee21f8-8f45-4fea-81f5-aff4fd8dde15 req-8aa67506-46a4-45f9-951f-1e12a0290995 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:23.288563 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-d0ee21f8-8f45-4fea-81f5-aff4fd8dde15 req-8aa67506-46a4-45f9-951f-1e12a0290995 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:23.318993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-d0ee21f8-8f45-4fea-81f5-aff4fd8dde15 req-8aa67506-46a4-45f9-951f-1e12a0290995 service nova] Creating event network-vif-deleted:5897603a-c758-4aef-b13d-a1bcac6199a0 for instance 04c02245-d347-4fe2-8836-ca64aeb90e74 on hv-cinder-80382 Jun 22 09:12:23.332730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-d0ee21f8-8f45-4fea-81f5-aff4fd8dde15 req-8aa67506-46a4-45f9-951f-1e12a0290995 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066298 Jun 22 09:12:23.334115 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 333/651] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:23.502058 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7cd102b6-48dc-473f-a770-714adce437cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:23.502669 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7cd102b6-48dc-473f-a770-714adce437cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:23.514751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7cd102b6-48dc-473f-a770-714adce437cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:23.514994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7cd102b6-48dc-473f-a770-714adce437cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:23.515781 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7cd102b6-48dc-473f-a770-714adce437cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:23.516215 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7cd102b6-48dc-473f-a770-714adce437cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:23.671271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:23.671271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:23.671271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:23.671271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:23.671842 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:23.671842 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:23.694707 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7cd102b6-48dc-473f-a770-714adce437cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:23.705426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7cd102b6-48dc-473f-a770-714adce437cc tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.209231 Jun 22 09:12:23.706233 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 319/652] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:23 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:23.738229 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:23.747346 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:23.748871 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:23.750206 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-45ab20fe-ee40-4caf-ac7c-52e03baeacfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1656 microversion: 2.20 time: 0.117291 Jun 22 09:12:23.750778 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 334/653] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:23 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1656 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:24.722506 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e955679e-f528-4703-aac7-5d9127a43fc9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:24.723833 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e955679e-f528-4703-aac7-5d9127a43fc9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:24.733034 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e955679e-f528-4703-aac7-5d9127a43fc9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:24.737079 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e955679e-f528-4703-aac7-5d9127a43fc9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:24.738467 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e955679e-f528-4703-aac7-5d9127a43fc9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:24.739300 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e955679e-f528-4703-aac7-5d9127a43fc9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:24.768696 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:24.769316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:24.782600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:24.783376 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:24.784344 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:24.784937 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:24.803039 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:24.824688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=6 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:24.837490 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:24.838470 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:24.839130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lazy-loading 'fault' on Instance uuid 04c02245-d347-4fe2-8836-ca64aeb90e74 {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:12:24.887440 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:24.897237 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:24.898770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:24.899997 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d4b57a5c-bfbb-4a6e-b650-71141c7e17dd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 200 len: 1371 microversion: 2.20 time: 0.135164 Jun 22 09:12:24.900549 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 335/654] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:24 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 1371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:24.987571 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e955679e-f528-4703-aac7-5d9127a43fc9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:24.995660 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e955679e-f528-4703-aac7-5d9127a43fc9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.277272 Jun 22 09:12:25.005115 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 320/655] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:24 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:25.918548 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:25.919268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:25.921656 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=6 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:25.928088 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:25.928759 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:25.929719 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:25.930152 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:25.948607 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] HTTP exception thrown: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Request method failure captured: Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 HTTP/1.1 Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistwZpJO17DX3MPEAArFqM1_jwUeRKWTmEffKF4aFNHuQ4QnFSsLvJ37SwfqQD8h24jf7IHcyDoY-T071N9F4q0tDgYG7nqSK-XhdNu8y77ermls-0I1IpsPKBo9y0AF6abtW3bCOgQ99pMvow6r2bmDkUlGZTncTF0XjZ9LwvkkbpK4 Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:12:25.951179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/27cd77392b924e64ba52350c775cf638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_27cd77392b924e64ba52350c775cf638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}] Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 8e3e567058964720964d98e76e55e462 Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:12:25.952818 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '04c02245-d347-4fe2-8836-ca64aeb90e74'} Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:12:25.953775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:12:25.955365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:25.959273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Returning 404 to user: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:12:25.959273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-de169d75-b2ce-4e5c-bb64-3fb6de249e0e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 404 len: 111 microversion: 2.20 time: 0.038522 Jun 22 09:12:25.959273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 336/656] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:25 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:12:25.964994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2b65c65a-0613-45b7-818b-f043d3fe01c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '.version_select at 0x7f500e30da60>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:26.012076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4c291d23-3481-4ad6-a535-7510eaf94c99 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:26.013214 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4c291d23-3481-4ad6-a535-7510eaf94c99 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:26.022171 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c291d23-3481-4ad6-a535-7510eaf94c99 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:26.025342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c291d23-3481-4ad6-a535-7510eaf94c99 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:26.025342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c291d23-3481-4ad6-a535-7510eaf94c99 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:26.025342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c291d23-3481-4ad6-a535-7510eaf94c99 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:26.046560 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2b65c65a-0613-45b7-818b-f043d3fe01c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376511490" status: 204 len: 0 microversion: 2.20 time: 0.085281 Jun 22 09:12:26.051014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 321/657] 10.222.0.55 () {60 vars in 1258 bytes} [Wed Jun 22 09:12:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376511490 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:12:26.202600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4c291d23-3481-4ad6-a535-7510eaf94c99 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:26.225812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4c291d23-3481-4ad6-a535-7510eaf94c99 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.207397 Jun 22 09:12:26.227084 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 337/658] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:26 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:27.092209 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8b71f1c4-2357-4974-bc54-54ec9b199010 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'create', calling method: .version_select at 0x7f500e30e160>, body: {"keypair": {"name": "tempest-keypair-1139394018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCytdfT0BlAN8oO3UP/EXyrMdK+IfThsPXlXjAEQczqhSvLqCwzYiGHUwYrz8C4eLQ6RCev7YZD4L8z6s2KRrZ0OtFpOkIUbc4J7wm1mqE4KkobV9N4x9aM2IviOVi1tkQ=="}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:27.109149 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-8b71f1c4-2357-4974-bc54-54ec9b199010 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Getting quotas for project 27cd77392b924e64ba52350c775cf638. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:12:27.112960 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-8b71f1c4-2357-4974-bc54-54ec9b199010 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Getting quotas for user 8e3e567058964720964d98e76e55e462 and project 27cd77392b924e64ba52350c775cf638. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:12:27.188748 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8b71f1c4-2357-4974-bc54-54ec9b199010 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.102021 Jun 22 09:12:27.189641 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 322/659] 10.222.0.55 () {62 vars in 1199 bytes} [Wed Jun 22 09:12:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 22 09:12:27.236522 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-67cb1777-20f8-4132-849c-06c8d8467d51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:27.237210 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-67cb1777-20f8-4132-849c-06c8d8467d51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:27.244106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-67cb1777-20f8-4132-849c-06c8d8467d51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:27.244554 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-67cb1777-20f8-4132-849c-06c8d8467d51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:27.245448 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-67cb1777-20f8-4132-849c-06c8d8467d51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:27.245878 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-67cb1777-20f8-4132-849c-06c8d8467d51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:27.428934 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-67cb1777-20f8-4132-849c-06c8d8467d51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:27.440139 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-67cb1777-20f8-4132-849c-06c8d8467d51 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.210007 Jun 22 09:12:27.440905 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 338/660] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:27 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:28.201870 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6b7ff109-8b19-4621-92f3-720771b37264 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:28.203072 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6b7ff109-8b19-4621-92f3-720771b37264 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:28.210032 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b7ff109-8b19-4621-92f3-720771b37264 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:28.210478 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b7ff109-8b19-4621-92f3-720771b37264 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:28.211265 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b7ff109-8b19-4621-92f3-720771b37264 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:28.211864 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6b7ff109-8b19-4621-92f3-720771b37264 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:28.314299 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-6b7ff109-8b19-4621-92f3-720771b37264 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lazy-loading 'services' on Instance uuid 6e593a5f-2134-4ca1-95b8-5f2e454dca54 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:12:28.459835 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-76f8ff0f-974b-45e1-9953-73657259d148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:28.466257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-76f8ff0f-974b-45e1-9953-73657259d148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:28.471699 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76f8ff0f-974b-45e1-9953-73657259d148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:28.472908 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76f8ff0f-974b-45e1-9953-73657259d148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:28.479733 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76f8ff0f-974b-45e1-9953-73657259d148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:28.480460 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76f8ff0f-974b-45e1-9953-73657259d148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:28.489462 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:28.615634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6b7ff109-8b19-4621-92f3-720771b37264 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments/82610842-de93-4bec-a747-3119d9805aba" status: 202 len: 0 microversion: 2.1 time: 0.417442 Jun 22 09:12:28.616855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 323/661] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:12:28 2022] DELETE /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments/82610842-de93-4bec-a747-3119d9805aba => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:12:28.627403 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c5558fca-92a4-45df-b5c7-27fede13d688 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:28.629912 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c5558fca-92a4-45df-b5c7-27fede13d688 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:28.642684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5558fca-92a4-45df-b5c7-27fede13d688 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:28.646590 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5558fca-92a4-45df-b5c7-27fede13d688 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:28.649716 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5558fca-92a4-45df-b5c7-27fede13d688 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:28.650365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5558fca-92a4-45df-b5c7-27fede13d688 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:28.679993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-76f8ff0f-974b-45e1-9953-73657259d148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:28.689895 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-76f8ff0f-974b-45e1-9953-73657259d148 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.234138 Jun 22 09:12:28.700068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 339/662] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:28 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:28.738323 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c5558fca-92a4-45df-b5c7-27fede13d688 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117198 Jun 22 09:12:28.739585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 324/663] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:28 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:29.081295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-0d674eca-177f-4c30-b7f8-6925b469ab5f req-84a44e6b-16af-4f23-b151-3b1c3b2e3bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da52f0d-9679-4693-8b50-b3891b62b1c4", "name": "network-vif-plugged", "status": "completed", "tag": "0c0a5a8c-c11e-4b3a-bbae-bb0484acd5fe"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:29.084722 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:29.090054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-0d674eca-177f-4c30-b7f8-6925b469ab5f req-84a44e6b-16af-4f23-b151-3b1c3b2e3bf9 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:29.090768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-0d674eca-177f-4c30-b7f8-6925b469ab5f req-84a44e6b-16af-4f23-b151-3b1c3b2e3bf9 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:29.103238 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-0d674eca-177f-4c30-b7f8-6925b469ab5f req-84a44e6b-16af-4f23-b151-3b1c3b2e3bf9 service nova] Creating event network-vif-plugged:0c0a5a8c-c11e-4b3a-bbae-bb0484acd5fe for instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 on hv-cinder-80382 Jun 22 09:12:29.109256 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-0d674eca-177f-4c30-b7f8-6925b469ab5f req-84a44e6b-16af-4f23-b151-3b1c3b2e3bf9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031562 Jun 22 09:12:29.109859 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 340/664] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:29.706992 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-03823881-9eff-4514-b4cb-352dd04d08eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:29.707584 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-03823881-9eff-4514-b4cb-352dd04d08eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:29.713779 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03823881-9eff-4514-b4cb-352dd04d08eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:29.714227 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03823881-9eff-4514-b4cb-352dd04d08eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:29.715043 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03823881-9eff-4514-b4cb-352dd04d08eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:29.722988 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-03823881-9eff-4514-b4cb-352dd04d08eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:29.751576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-439269142", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dc0d09c-c23d-458d-8834-ba6f7c377f1b"}], "security_groups": [{"name": "tempest-securitygroup--18604702"}], "key_name": "tempest-keypair-1139394018", "user_data": "}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:29.926480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] validate_networks() for [('4dc0d09c-c23d-458d-8834-ba6f7c377f1b', None, None, None, None, None)] {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:12:29.939069 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-03823881-9eff-4514-b4cb-352dd04d08eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:29.948883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-03823881-9eff-4514-b4cb-352dd04d08eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.245606 Jun 22 09:12:29.959530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 325/665] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:29 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:29.959530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-971ba58e-48a8-44c6-9dc3-e40348a6b294 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:29.959530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-971ba58e-48a8-44c6-9dc3-e40348a6b294 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:29.963441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-971ba58e-48a8-44c6-9dc3-e40348a6b294 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:29.964144 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-971ba58e-48a8-44c6-9dc3-e40348a6b294 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:29.965082 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-971ba58e-48a8-44c6-9dc3-e40348a6b294 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:29.965702 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-971ba58e-48a8-44c6-9dc3-e40348a6b294 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:30.004584 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-971ba58e-48a8-44c6-9dc3-e40348a6b294 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052820 Jun 22 09:12:30.005094 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 326/666] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:29 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:30.371622 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:12:30.371622 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:12:30.371622 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:12:30.371622 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:12:30.371622 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:12:30.375365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:30.375815 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:30.376635 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:30.377098 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:30.394256 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Getting quotas for project 27cd77392b924e64ba52350c775cf638. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:12:30.398378 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Getting quotas for user 8e3e567058964720964d98e76e55e462 and project 27cd77392b924e64ba52350c775cf638. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:12:30.409552 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:12:30.412054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:12:30.635787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7fd248a3-be41-435a-b238-bdf04d9bbfc2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.890042 Jun 22 09:12:30.636361 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 341/667] 10.222.0.55 () {62 vars in 1187 bytes} [Wed Jun 22 09:12:29 2022] POST /compute/v2.1/servers => generated 400 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 09:12:30.646590 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-de598e71-2563-4c72-8603-a95c31abe405 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:30.647214 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-de598e71-2563-4c72-8603-a95c31abe405 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:30.718452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-de598e71-2563-4c72-8603-a95c31abe405 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:30.727949 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-de598e71-2563-4c72-8603-a95c31abe405 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:30.730167 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-de598e71-2563-4c72-8603-a95c31abe405 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:30.732814 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-de598e71-2563-4c72-8603-a95c31abe405 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1281 microversion: 2.20 time: 0.090156 Jun 22 09:12:30.733684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 327/668] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:30 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:30.967635 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0d54ab96-6d24-49b0-8549-c547bf399083 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:30.968894 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0d54ab96-6d24-49b0-8549-c547bf399083 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:30.975583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d54ab96-6d24-49b0-8549-c547bf399083 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:30.976298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d54ab96-6d24-49b0-8549-c547bf399083 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:30.977715 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d54ab96-6d24-49b0-8549-c547bf399083 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:30.978358 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d54ab96-6d24-49b0-8549-c547bf399083 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.016872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-54c683a1-b876-4c41-a355-6b65da3cd419 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:31.017978 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-54c683a1-b876-4c41-a355-6b65da3cd419 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:31.028147 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-54c683a1-b876-4c41-a355-6b65da3cd419 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.032243 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-54c683a1-b876-4c41-a355-6b65da3cd419 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.032243 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-54c683a1-b876-4c41-a355-6b65da3cd419 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.032243 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-54c683a1-b876-4c41-a355-6b65da3cd419 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.080235 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-54c683a1-b876-4c41-a355-6b65da3cd419 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059785 Jun 22 09:12:31.080235 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 328/669] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:31 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:12:31.154114 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0d54ab96-6d24-49b0-8549-c547bf399083 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:31.158262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-48f77ecf-ec0e-43f8-b018-f9744757ceb6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:31.158837 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-48f77ecf-ec0e-43f8-b018-f9744757ceb6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:31.161886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0d54ab96-6d24-49b0-8549-c547bf399083 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1362 microversion: 2.1 time: 0.198763 Jun 22 09:12:31.162503 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 342/670] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:30 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:31.165464 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-48f77ecf-ec0e-43f8-b018-f9744757ceb6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.165982 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-48f77ecf-ec0e-43f8-b018-f9744757ceb6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.166740 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-48f77ecf-ec0e-43f8-b018-f9744757ceb6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.167193 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-48f77ecf-ec0e-43f8-b018-f9744757ceb6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.192860 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-48f77ecf-ec0e-43f8-b018-f9744757ceb6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:12:31.462420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-48f77ecf-ec0e-43f8-b018-f9744757ceb6 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 204 len: 0 microversion: 2.1 time: 0.312043 Jun 22 09:12:31.463042 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 329/671] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:12:31 2022] DELETE /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:12:31.471911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ba774d01-5e5d-4803-9506-a9490288f6fd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:31.472515 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ba774d01-5e5d-4803-9506-a9490288f6fd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:31.479187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ba774d01-5e5d-4803-9506-a9490288f6fd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.479646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ba774d01-5e5d-4803-9506-a9490288f6fd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.480454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ba774d01-5e5d-4803-9506-a9490288f6fd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.480950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ba774d01-5e5d-4803-9506-a9490288f6fd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.481560 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1ab2332e-e93f-418d-a759-660c7311ed5e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Action: 'create', calling method: .version_select at 0x7f500e2e3310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-939888713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtcYFnm6UYkWdZcA67G4Kv1aYRnQEiyFAqYZNwkQI4ivppZG4VbGvaHE0xSUL2OpPcrYb/JbIf2XmLEtbS54LC7W363SyZj980Yh6Bvby+6BLeJoqEhSE20NWE1uYX9WQ=="}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:31.496554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-1ab2332e-e93f-418d-a759-660c7311ed5e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Getting quotas for project 476725d6c5c44caebdd8d8e855cc63c6. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:12:31.501280 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-1ab2332e-e93f-418d-a759-660c7311ed5e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Getting quotas for user 4d6a812133cf437fa3e13f56d1cddd53 and project 476725d6c5c44caebdd8d8e855cc63c6. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:12:31.613699 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ba774d01-5e5d-4803-9506-a9490288f6fd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:31.621074 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ba774d01-5e5d-4803-9506-a9490288f6fd tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1686 microversion: 2.1 time: 0.153280 Jun 22 09:12:31.621827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 343/672] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:31 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:31.621964 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1ab2332e-e93f-418d-a759-660c7311ed5e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.145286 Jun 22 09:12:31.622530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 330/673] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:12:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:31.674672 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-157798693", "imageRef": "ee3d5800-ca09-4dc1-a281-3581f80683cc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-939888713", "networks": [{"uuid": "691a4d14-7c44-49d6-8787-1e10ee793579"}]}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:31.721377 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] validate_networks() for [('691a4d14-7c44-49d6-8787-1e10ee793579', None, None, None, None, None)] {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:12:31.757388 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:31.758104 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:31.764793 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.765240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.765966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:31.766391 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:31.828278 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:31.836617 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:31.838108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:31.839248 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7fb27da5-1aed-4513-9d38-f3ac4fe8ab31 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1285 microversion: 2.20 time: 0.086213 Jun 22 09:12:31.839824 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 331/674] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:31 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:32.181303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4ac1b72e-6aaa-40b8-87a1-4216525fb6df tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:32.181908 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4ac1b72e-6aaa-40b8-87a1-4216525fb6df tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:32.188441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4ac1b72e-6aaa-40b8-87a1-4216525fb6df tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.188886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4ac1b72e-6aaa-40b8-87a1-4216525fb6df tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.189641 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4ac1b72e-6aaa-40b8-87a1-4216525fb6df tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.190074 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4ac1b72e-6aaa-40b8-87a1-4216525fb6df tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.304648 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:12:32.305142 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:12:32.305651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:12:32.306067 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:12:32.306502 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:12:32.315746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.316189 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.316982 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.317428 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.320250 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4ac1b72e-6aaa-40b8-87a1-4216525fb6df tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:32.328425 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4ac1b72e-6aaa-40b8-87a1-4216525fb6df tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1548 microversion: 2.1 time: 0.150948 Jun 22 09:12:32.329097 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 332/675] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:32 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:32.334404 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Getting quotas for project 476725d6c5c44caebdd8d8e855cc63c6. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:12:32.338142 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Getting quotas for user 4d6a812133cf437fa3e13f56d1cddd53 and project 476725d6c5c44caebdd8d8e855cc63c6. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:12:32.344604 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fde58ecc-d860-4196-bfa6-fb7b49aa0c72 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:32.345103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fde58ecc-d860-4196-bfa6-fb7b49aa0c72 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:32.349193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:12:32.351266 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fde58ecc-d860-4196-bfa6-fb7b49aa0c72 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.351389 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee3d5800-ca09-4dc1-a281-3581f80683cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:12:32.351715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fde58ecc-d860-4196-bfa6-fb7b49aa0c72 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.352743 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fde58ecc-d860-4196-bfa6-fb7b49aa0c72 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.353180 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fde58ecc-d860-4196-bfa6-fb7b49aa0c72 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.428747 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fde58ecc-d860-4196-bfa6-fb7b49aa0c72 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087773 Jun 22 09:12:32.429345 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 333/676] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 22 09:12:32 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:32.503796 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-53752ae0-3b1d-4d3f-b845-a7daef008bec tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832799 Jun 22 09:12:32.504741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 344/677] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:12:32.516825 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ca159b09-2f35-4dbd-9aa3-abe4c200cefd tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:32.516825 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ca159b09-2f35-4dbd-9aa3-abe4c200cefd tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:32.517831 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:32.593470 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ca159b09-2f35-4dbd-9aa3-abe4c200cefd tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:32.600772 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ca159b09-2f35-4dbd-9aa3-abe4c200cefd tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1257 microversion: 2.1 time: 0.089774 Jun 22 09:12:32.611047 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 334/678] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:32 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1257 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:32.637717 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-058e83e6-7218-476d-b088-fa5b6fc68f3d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:32.638337 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-058e83e6-7218-476d-b088-fa5b6fc68f3d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:32.644926 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-058e83e6-7218-476d-b088-fa5b6fc68f3d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.645581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-058e83e6-7218-476d-b088-fa5b6fc68f3d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.646353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-058e83e6-7218-476d-b088-fa5b6fc68f3d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.646792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-058e83e6-7218-476d-b088-fa5b6fc68f3d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.778809 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-058e83e6-7218-476d-b088-fa5b6fc68f3d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:32.786913 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-058e83e6-7218-476d-b088-fa5b6fc68f3d tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1686 microversion: 2.1 time: 0.153101 Jun 22 09:12:32.787771 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 345/679] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:32 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:32.858252 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:32.858809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:32.866554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.867033 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.867787 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.868216 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.960291 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:32.968742 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:32.970523 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:32.971655 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-736af772-b3f2-471c-9e93-d1a6f92fb306 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1285 microversion: 2.20 time: 0.117883 Jun 22 09:12:32.972200 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 335/680] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:32 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:33.468374 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-22ea083d-9a48-4286-99b3-d7b3efdc6014 req-fd83e57b-df5a-43af-9170-ce339b27f50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da52f0d-9679-4693-8b50-b3891b62b1c4", "tag": "0c0a5a8c-c11e-4b3a-bbae-bb0484acd5fe"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:33.480007 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-22ea083d-9a48-4286-99b3-d7b3efdc6014 req-fd83e57b-df5a-43af-9170-ce339b27f50a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.480767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-22ea083d-9a48-4286-99b3-d7b3efdc6014 req-fd83e57b-df5a-43af-9170-ce339b27f50a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.493693 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-22ea083d-9a48-4286-99b3-d7b3efdc6014 req-fd83e57b-df5a-43af-9170-ce339b27f50a service nova] Creating event network-changed:0c0a5a8c-c11e-4b3a-bbae-bb0484acd5fe for instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 on hv-cinder-80382 Jun 22 09:12:33.498649 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-22ea083d-9a48-4286-99b3-d7b3efdc6014 req-fd83e57b-df5a-43af-9170-ce339b27f50a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034440 Jun 22 09:12:33.499276 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 346/681] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:33.621546 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-58e7ce63-e118-4033-a2cc-873de88f465f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:33.622464 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-58e7ce63-e118-4033-a2cc-873de88f465f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:33.628508 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-58e7ce63-e118-4033-a2cc-873de88f465f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.628948 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-58e7ce63-e118-4033-a2cc-873de88f465f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.629696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-58e7ce63-e118-4033-a2cc-873de88f465f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.630122 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-58e7ce63-e118-4033-a2cc-873de88f465f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.691579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-58e7ce63-e118-4033-a2cc-873de88f465f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:33.698858 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-58e7ce63-e118-4033-a2cc-873de88f465f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1261 microversion: 2.1 time: 0.081815 Jun 22 09:12:33.699433 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 336/682] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:33 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:33.805720 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-79aa0a56-11fe-4e76-a7f0-8088447cba36 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:33.806415 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-79aa0a56-11fe-4e76-a7f0-8088447cba36 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:33.813436 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-79aa0a56-11fe-4e76-a7f0-8088447cba36 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.813875 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-79aa0a56-11fe-4e76-a7f0-8088447cba36 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.814645 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-79aa0a56-11fe-4e76-a7f0-8088447cba36 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.815098 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-79aa0a56-11fe-4e76-a7f0-8088447cba36 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.948147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-79aa0a56-11fe-4e76-a7f0-8088447cba36 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:33.956604 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-79aa0a56-11fe-4e76-a7f0-8088447cba36 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1686 microversion: 2.1 time: 0.155578 Jun 22 09:12:33.957201 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 347/683] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:33 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:33.989531 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:33.990238 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:33.997275 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.997797 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.998629 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.999178 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:34.058886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:34.067452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:34.068968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:34.070069 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a66ab69d-350d-40ea-a635-72a8e0107d7c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1285 microversion: 2.20 time: 0.084569 Jun 22 09:12:34.070662 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 337/684] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:33 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:34.717288 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cbcd200b-e316-4e6d-8604-623c4e53752d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:34.717914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cbcd200b-e316-4e6d-8604-623c4e53752d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:34.727014 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cbcd200b-e316-4e6d-8604-623c4e53752d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:34.729614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cbcd200b-e316-4e6d-8604-623c4e53752d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:34.729614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cbcd200b-e316-4e6d-8604-623c4e53752d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:34.729614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cbcd200b-e316-4e6d-8604-623c4e53752d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:34.796229 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cbcd200b-e316-4e6d-8604-623c4e53752d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:34.806170 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cbcd200b-e316-4e6d-8604-623c4e53752d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1261 microversion: 2.1 time: 0.093860 Jun 22 09:12:34.806751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 348/685] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:34 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:34.974743 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2a250035-eff7-4e03-a370-2682f0b693c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:34.975381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2a250035-eff7-4e03-a370-2682f0b693c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:34.981674 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2a250035-eff7-4e03-a370-2682f0b693c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:34.982113 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2a250035-eff7-4e03-a370-2682f0b693c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:34.982891 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2a250035-eff7-4e03-a370-2682f0b693c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:34.983321 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2a250035-eff7-4e03-a370-2682f0b693c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:35.088566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:35.089314 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:35.096514 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:35.096962 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:35.097759 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:35.098193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:35.101188 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:35.173250 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:35.183154 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:35.185612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:35.186876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2869d257-da1b-416e-bee4-ef49795d084d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1277 microversion: 2.20 time: 0.102500 Jun 22 09:12:35.187557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 349/686] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:35 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:35.515498 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2a250035-eff7-4e03-a370-2682f0b693c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:35.522921 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2a250035-eff7-4e03-a370-2682f0b693c3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1686 microversion: 2.1 time: 0.551918 Jun 22 09:12:35.523502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 338/687] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:34 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1686 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:35.822196 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b063b963-5981-4b27-a23f-f9effe44de81 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:35.823253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b063b963-5981-4b27-a23f-f9effe44de81 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:35.829789 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b063b963-5981-4b27-a23f-f9effe44de81 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:35.830241 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b063b963-5981-4b27-a23f-f9effe44de81 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:35.831037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b063b963-5981-4b27-a23f-f9effe44de81 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:35.831473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b063b963-5981-4b27-a23f-f9effe44de81 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:35.901434 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b063b963-5981-4b27-a23f-f9effe44de81 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:35.911042 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b063b963-5981-4b27-a23f-f9effe44de81 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1309 microversion: 2.1 time: 0.092497 Jun 22 09:12:35.911880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 350/688] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:35 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:36.206451 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:36.207560 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:36.217048 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.219105 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.220085 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.220528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.382567 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:36.391691 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:36.394359 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:36.394640 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e018cf0d-a9e0-44a2-87f1-11c2db372a53 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1351 microversion: 2.20 time: 0.192600 Jun 22 09:12:36.395246 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 339/689] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:36 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:36.540480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-69d8cc70-3790-4c5f-a631-6cd365ad153b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:36.541119 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-69d8cc70-3790-4c5f-a631-6cd365ad153b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:36.547682 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-69d8cc70-3790-4c5f-a631-6cd365ad153b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.548360 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-69d8cc70-3790-4c5f-a631-6cd365ad153b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.549368 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-69d8cc70-3790-4c5f-a631-6cd365ad153b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.549799 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-69d8cc70-3790-4c5f-a631-6cd365ad153b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.637549 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-69d8cc70-3790-4c5f-a631-6cd365ad153b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:36.650407 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-69d8cc70-3790-4c5f-a631-6cd365ad153b tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1618 microversion: 2.1 time: 0.113602 Jun 22 09:12:36.652507 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 351/690] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:36 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1618 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:36.732834 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-d31a1b6a-f1be-49c4-bf0d-ac3a39a7eeb2 req-0fb0935d-10f8-46a5-aedb-34d6a8adedf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e593a5f-2134-4ca1-95b8-5f2e454dca54", "name": "network-vif-deleted", "tag": "c3ed1249-4d90-4b41-b5b8-c3d483a0e086"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:36.753726 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-d31a1b6a-f1be-49c4-bf0d-ac3a39a7eeb2 req-0fb0935d-10f8-46a5-aedb-34d6a8adedf9 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.755021 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-d31a1b6a-f1be-49c4-bf0d-ac3a39a7eeb2 req-0fb0935d-10f8-46a5-aedb-34d6a8adedf9 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.775692 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-d31a1b6a-f1be-49c4-bf0d-ac3a39a7eeb2 req-0fb0935d-10f8-46a5-aedb-34d6a8adedf9 service nova] Creating event network-vif-deleted:c3ed1249-4d90-4b41-b5b8-c3d483a0e086 for instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 on hv-cinder-80382 Jun 22 09:12:36.783542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-d31a1b6a-f1be-49c4-bf0d-ac3a39a7eeb2 req-0fb0935d-10f8-46a5-aedb-34d6a8adedf9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058231 Jun 22 09:12:36.784768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 340/691] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:36.928426 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-24e4b9b5-7c61-4732-9d38-8cf07651878a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:36.929765 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-24e4b9b5-7c61-4732-9d38-8cf07651878a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:36.937135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-24e4b9b5-7c61-4732-9d38-8cf07651878a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.937882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-24e4b9b5-7c61-4732-9d38-8cf07651878a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.943417 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-24e4b9b5-7c61-4732-9d38-8cf07651878a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.943417 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-24e4b9b5-7c61-4732-9d38-8cf07651878a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.035854 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-24e4b9b5-7c61-4732-9d38-8cf07651878a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:37.063131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-24e4b9b5-7c61-4732-9d38-8cf07651878a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1315 microversion: 2.1 time: 0.138370 Jun 22 09:12:37.075425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 352/692] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:36 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:37.414780 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:37.415457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:37.431479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.438377 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.439009 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.439164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.795783 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0a441c4e-4523-4699-8276-cce27ac568bf tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:37.796312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0a441c4e-4523-4699-8276-cce27ac568bf tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:37.814254 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0a441c4e-4523-4699-8276-cce27ac568bf tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.819612 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0a441c4e-4523-4699-8276-cce27ac568bf tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.820695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0a441c4e-4523-4699-8276-cce27ac568bf tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.821296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0a441c4e-4523-4699-8276-cce27ac568bf tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.888694 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0a441c4e-4523-4699-8276-cce27ac568bf tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/ips" status: 200 len: 150 microversion: 2.1 time: 0.509965 Jun 22 09:12:37.905750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 341/693] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:12:37 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/ips => generated 150 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:37.927112 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:37.927957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:37.944659 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.945116 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.945914 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.946404 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.997029 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:38.006283 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:38.007833 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:38.021173 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:38.022001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:38.022662 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lazy-loading 'fault' on Instance uuid 6e593a5f-2134-4ca1-95b8-5f2e454dca54 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:12:38.025612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a00e7462-28c0-44ae-9902-a41326b34b83 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.613585 Jun 22 09:12:38.026851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 353/694] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:37 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:38.092051 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-db4d1838-fdcb-428e-990c-44bb08bea199 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:38.092051 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-db4d1838-fdcb-428e-990c-44bb08bea199 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:38.093810 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:38.098009 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:38.107193 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-25dbf7d4-e38c-4410-8d54-d5b47af887c0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 200 len: 1332 microversion: 2.1 time: 0.200007 Jun 22 09:12:38.108096 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 342/695] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:37 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 1332 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:38.109821 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-db4d1838-fdcb-428e-990c-44bb08bea199 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:38.120844 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-db4d1838-fdcb-428e-990c-44bb08bea199 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:38.123518 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-db4d1838-fdcb-428e-990c-44bb08bea199 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:38.125332 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-db4d1838-fdcb-428e-990c-44bb08bea199 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:38.427286 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-db4d1838-fdcb-428e-990c-44bb08bea199 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:38.436455 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-db4d1838-fdcb-428e-990c-44bb08bea199 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.358301 Jun 22 09:12:38.447277 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 354/696] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:38 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:38.958675 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-2f9a1bbf-92ee-4382-988f-47934a3dfad6 req-6da5e82a-63ad-4f49-bfcb-ddb40a61f141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88cfdf9-1c62-4867-ae38-32484e4b2fdd", "tag": "80ee4f92-8e74-49ff-9d1e-85edcc14992c"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:38.969606 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-2f9a1bbf-92ee-4382-988f-47934a3dfad6 req-6da5e82a-63ad-4f49-bfcb-ddb40a61f141 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:38.970319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-2f9a1bbf-92ee-4382-988f-47934a3dfad6 req-6da5e82a-63ad-4f49-bfcb-ddb40a61f141 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.009498 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-2f9a1bbf-92ee-4382-988f-47934a3dfad6 req-6da5e82a-63ad-4f49-bfcb-ddb40a61f141 service nova] Creating event network-changed:80ee4f92-8e74-49ff-9d1e-85edcc14992c for instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd on hv-cinder-80382 Jun 22 09:12:39.015077 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-2f9a1bbf-92ee-4382-988f-47934a3dfad6 req-6da5e82a-63ad-4f49-bfcb-ddb40a61f141 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063167 Jun 22 09:12:39.016105 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 343/697] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:39.046268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:39.047031 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:39.063571 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.070590 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.071876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.072498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.133352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:39.134291 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 6e593a5f-2134-4ca1-95b8-5f2e454dca54] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:39.155224 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.155224 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.155224 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.155224 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.179110 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] HTTP exception thrown: Instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 could not be found. Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Request method failure captured: Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 HTTP/1.1 Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvHffkrcURPh5_p8DJ-OorG_jbpSa-9p7eRx2v0zUADKz4LoPZtA5Q_L-q42DvwL6rJ9BAkjazfPS3Q0VCpFJjRznzp8sl5hkv1cyTFXp8TvntWMEfIgtZqeRDBE9-1QqNO_TS597PJxaXTlyTT82OW19HSLE8KvEstAKAWo3BcBBM Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:12:39.180855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}] Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 71ac6423996b4e5d906de9ff6986fb03 Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 could not be found. Jun 22 09:12:39.185328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '6e593a5f-2134-4ca1-95b8-5f2e454dca54'} Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 could not be found. Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:12:39.186444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 could not be found. Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 could not be found. Jun 22 09:12:39.187727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:12:39.190768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Returning 404 to user: Instance 6e593a5f-2134-4ca1-95b8-5f2e454dca54 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:12:39.190768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8170f4f4-72bb-4af5-90a4-1c3632665c3f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54" status: 404 len: 111 microversion: 2.1 time: 0.054807 Jun 22 09:12:39.190768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 344/698] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:39 2022] GET /compute/v2.1/servers/6e593a5f-2134-4ca1-95b8-5f2e454dca54 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:12:39.192159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-607dc338-9a29-4136-afd5-469ff2dc869a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '.version_select at 0x7f500e30d0d0>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:39.298493 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-607dc338-9a29-4136-afd5-469ff2dc869a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422898440" status: 202 len: 0 microversion: 2.1 time: 0.110544 Jun 22 09:12:39.304234 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 345/699] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 22 09:12:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422898440 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:12:39.457345 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9b2c74dd-8e07-49c5-80e8-a28193c3b5ca tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:39.457968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9b2c74dd-8e07-49c5-80e8-a28193c3b5ca tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:39.488301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b2c74dd-8e07-49c5-80e8-a28193c3b5ca tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.489934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b2c74dd-8e07-49c5-80e8-a28193c3b5ca tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.493596 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b2c74dd-8e07-49c5-80e8-a28193c3b5ca tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.494126 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b2c74dd-8e07-49c5-80e8-a28193c3b5ca tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.689664 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:39.715983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:39.717942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:39.723563 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-41a19798-76ed-4c59-bbb5-d5aeb44eaa51 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.681843 Jun 22 09:12:39.725475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 355/700] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:39 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:39.836898 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-3d40986d-ecf0-4eb4-a0c8-54b5bffe0bb8 req-d6b9859e-1472-49d8-8155-7af017386c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93eaaa7c-1a8d-404e-9194-0ef4556feee7", "tag": "687407a6-7cc6-4eaa-a14c-ef82cef3aa05"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:39.852273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-3d40986d-ecf0-4eb4-a0c8-54b5bffe0bb8 req-d6b9859e-1472-49d8-8155-7af017386c12 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.853950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-3d40986d-ecf0-4eb4-a0c8-54b5bffe0bb8 req-d6b9859e-1472-49d8-8155-7af017386c12 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.880046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9b2c74dd-8e07-49c5-80e8-a28193c3b5ca tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:39.895369 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-3d40986d-ecf0-4eb4-a0c8-54b5bffe0bb8 req-d6b9859e-1472-49d8-8155-7af017386c12 service nova] Creating event network-changed:687407a6-7cc6-4eaa-a14c-ef82cef3aa05 for instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 on hv-cinder-80382 Jun 22 09:12:39.897196 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9b2c74dd-8e07-49c5-80e8-a28193c3b5ca tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.443964 Jun 22 09:12:39.900929 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 346/701] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:39 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:39.908356 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-3d40986d-ecf0-4eb4-a0c8-54b5bffe0bb8 req-d6b9859e-1472-49d8-8155-7af017386c12 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179975 Jun 22 09:12:39.911917 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 356/702] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:39.961700 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e0ce6681-19eb-4db5-b498-39128dc3bee4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5202f955-1710-4861-9a7d-b51b214ee24a"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:39.963602 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e0ce6681-19eb-4db5-b498-39128dc3bee4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:39.970886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e0ce6681-19eb-4db5-b498-39128dc3bee4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.971827 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e0ce6681-19eb-4db5-b498-39128dc3bee4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:39.973131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e0ce6681-19eb-4db5-b498-39128dc3bee4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:39.974008 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e0ce6681-19eb-4db5-b498-39128dc3bee4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:40.745911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:40.746537 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:40.753776 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:40.754221 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:40.755046 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:40.755480 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:40.935527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:40.943559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:40.945061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:40.946233 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1717af1b-202c-4a72-b2d6-b7e7b760ae04 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.204664 Jun 22 09:12:40.947125 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 357/703] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:40 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:40.952485 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7b6b4301-be5d-444d-8040-dd547f01fb8b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:40.953922 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7b6b4301-be5d-444d-8040-dd547f01fb8b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:40.965917 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b6b4301-be5d-444d-8040-dd547f01fb8b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:40.966368 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b6b4301-be5d-444d-8040-dd547f01fb8b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:40.967174 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b6b4301-be5d-444d-8040-dd547f01fb8b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:40.967606 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b6b4301-be5d-444d-8040-dd547f01fb8b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:41.106425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7b6b4301-be5d-444d-8040-dd547f01fb8b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:41.114014 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7b6b4301-be5d-444d-8040-dd547f01fb8b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.165742 Jun 22 09:12:41.114578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 358/704] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:40 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:41.966761 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:41.967529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:41.977107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:41.977551 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:41.978580 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:41.979053 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:42.129960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:42.140787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:42.142904 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:42.150768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-61048911-d0a9-4d20-8c04-85386d6bd3d2 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.183404 Jun 22 09:12:42.150768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 359/705] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:41 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:42.150768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f2e3aac1-92a9-42ad-bd27-4b64bf4ea966 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:42.150768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f2e3aac1-92a9-42ad-bd27-4b64bf4ea966 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:42.158869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2e3aac1-92a9-42ad-bd27-4b64bf4ea966 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:42.159592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2e3aac1-92a9-42ad-bd27-4b64bf4ea966 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:42.160370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2e3aac1-92a9-42ad-bd27-4b64bf4ea966 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:42.160883 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f2e3aac1-92a9-42ad-bd27-4b64bf4ea966 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:42.305032 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f2e3aac1-92a9-42ad-bd27-4b64bf4ea966 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:42.312794 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f2e3aac1-92a9-42ad-bd27-4b64bf4ea966 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.166759 Jun 22 09:12:42.313367 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 360/706] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:42 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:42.599739 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=12 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:43.169000 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:43.169725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:43.172212 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=4 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:43.173028 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=12 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:43.178255 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.178696 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.179487 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.179953 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.323478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:43.342694 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:43.344297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:43.345404 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7eb7d81f-77c9-4d5f-b93a-6049d60ee98b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.180945 Jun 22 09:12:43.346275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 361/707] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:43 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:43.351097 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-66e7a6dd-b6c2-4678-a797-701e1c8ca5a1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:43.352350 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-66e7a6dd-b6c2-4678-a797-701e1c8ca5a1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:43.360753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-66e7a6dd-b6c2-4678-a797-701e1c8ca5a1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.365054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-66e7a6dd-b6c2-4678-a797-701e1c8ca5a1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.365054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-66e7a6dd-b6c2-4678-a797-701e1c8ca5a1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.365054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-66e7a6dd-b6c2-4678-a797-701e1c8ca5a1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.391496 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-66e7a6dd-b6c2-4678-a797-701e1c8ca5a1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Going to try to terminate instance {{(pid=118268) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:12:43.667584 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-66e7a6dd-b6c2-4678-a797-701e1c8ca5a1 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 204 len: 0 microversion: 2.1 time: 0.319743 Jun 22 09:12:43.668875 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 362/708] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:12:43 2022] DELETE /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:12:43.674415 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4ed39593-47a3-4e0f-aa6a-13433a34b67c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:43.677784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4ed39593-47a3-4e0f-aa6a-13433a34b67c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:43.684467 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4ed39593-47a3-4e0f-aa6a-13433a34b67c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.685022 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4ed39593-47a3-4e0f-aa6a-13433a34b67c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.685857 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4ed39593-47a3-4e0f-aa6a-13433a34b67c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.686362 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4ed39593-47a3-4e0f-aa6a-13433a34b67c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.835509 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4ed39593-47a3-4e0f-aa6a-13433a34b67c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:43.843467 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4ed39593-47a3-4e0f-aa6a-13433a34b67c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.173189 Jun 22 09:12:43.844394 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 363/709] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:43 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:43.848886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d665641b-48ce-4b30-bac2-6334df4cde34 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:43.849492 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d665641b-48ce-4b30-bac2-6334df4cde34 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:43.856512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d665641b-48ce-4b30-bac2-6334df4cde34 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.856958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d665641b-48ce-4b30-bac2-6334df4cde34 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.857714 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d665641b-48ce-4b30-bac2-6334df4cde34 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.858148 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d665641b-48ce-4b30-bac2-6334df4cde34 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.994396 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d665641b-48ce-4b30-bac2-6334df4cde34 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:43.996757 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:44.002721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d665641b-48ce-4b30-bac2-6334df4cde34 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1508 microversion: 2.1 time: 0.157405 Jun 22 09:12:44.003315 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 364/710] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:43 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:44.364430 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:44.365083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:44.372737 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:44.373179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:44.373994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:44.374426 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:44.508306 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:44.517025 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:44.518983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:44.520306 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-27dbd18c-f386-4c00-988c-ffbb2ea9799a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.159792 Jun 22 09:12:44.521094 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 365/711] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:44 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:44.861131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-55789fa0-89ae-4ed4-838b-69d47b670c2d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:44.861754 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-55789fa0-89ae-4ed4-838b-69d47b670c2d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:44.869173 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-55789fa0-89ae-4ed4-838b-69d47b670c2d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:44.869835 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-55789fa0-89ae-4ed4-838b-69d47b670c2d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:44.870988 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-55789fa0-89ae-4ed4-838b-69d47b670c2d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:44.872583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-55789fa0-89ae-4ed4-838b-69d47b670c2d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:45.007586 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-55789fa0-89ae-4ed4-838b-69d47b670c2d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:45.015536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-55789fa0-89ae-4ed4-838b-69d47b670c2d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.158176 Jun 22 09:12:45.016293 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 366/712] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:44 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:45.030098 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-986f7aa0-a2a0-4be3-8c84-ed97b25d2f94 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:45.030740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-986f7aa0-a2a0-4be3-8c84-ed97b25d2f94 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:45.037150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-986f7aa0-a2a0-4be3-8c84-ed97b25d2f94 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:45.037800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-986f7aa0-a2a0-4be3-8c84-ed97b25d2f94 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:45.038689 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-986f7aa0-a2a0-4be3-8c84-ed97b25d2f94 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:45.039331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-986f7aa0-a2a0-4be3-8c84-ed97b25d2f94 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:45.173661 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-986f7aa0-a2a0-4be3-8c84-ed97b25d2f94 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:45.182389 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-986f7aa0-a2a0-4be3-8c84-ed97b25d2f94 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1508 microversion: 2.1 time: 0.156392 Jun 22 09:12:45.182980 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 367/713] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:45 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:45.539003 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:45.539709 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:45.546990 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:45.547456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:45.548363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:45.548792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:45.689725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:45.697767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:45.699274 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:45.700528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5b04eadf-e367-4030-9cae-ef85f1aecd5f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.165931 Jun 22 09:12:45.701082 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 368/714] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:45 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:46.032107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-50d21495-be64-4138-8119-41c0384dc096 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:46.032951 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-50d21495-be64-4138-8119-41c0384dc096 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:46.039131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-50d21495-be64-4138-8119-41c0384dc096 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:46.039652 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-50d21495-be64-4138-8119-41c0384dc096 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:46.040598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-50d21495-be64-4138-8119-41c0384dc096 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:46.041088 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-50d21495-be64-4138-8119-41c0384dc096 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:46.176299 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-50d21495-be64-4138-8119-41c0384dc096 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:46.186146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-50d21495-be64-4138-8119-41c0384dc096 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.158288 Jun 22 09:12:46.195561 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 369/715] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:46 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:46.201723 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b276abf4-4125-4e15-aa24-827cb369f69a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:46.202416 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b276abf4-4125-4e15-aa24-827cb369f69a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:46.208524 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b276abf4-4125-4e15-aa24-827cb369f69a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:46.208961 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b276abf4-4125-4e15-aa24-827cb369f69a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:46.209717 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b276abf4-4125-4e15-aa24-827cb369f69a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:46.210142 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b276abf4-4125-4e15-aa24-827cb369f69a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:46.347765 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b276abf4-4125-4e15-aa24-827cb369f69a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:46.355875 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b276abf4-4125-4e15-aa24-827cb369f69a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1508 microversion: 2.1 time: 0.159103 Jun 22 09:12:46.364287 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 370/716] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:46 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:46.717488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:46.718197 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:46.721587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:46.725241 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:46.725684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:46.726452 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:46.726960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:46.860274 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:46.868598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:46.870106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:46.871322 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-65173139-def3-492a-b4c0-fad19aae74a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.157655 Jun 22 09:12:46.872430 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 371/717] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:46 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:47.203595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-213fcc90-644a-4967-8154-ac6b45ded2ab tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:47.204227 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-213fcc90-644a-4967-8154-ac6b45ded2ab tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:47.210163 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-213fcc90-644a-4967-8154-ac6b45ded2ab tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.210601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-213fcc90-644a-4967-8154-ac6b45ded2ab tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:47.211381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-213fcc90-644a-4967-8154-ac6b45ded2ab tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.211810 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-213fcc90-644a-4967-8154-ac6b45ded2ab tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:47.338729 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-213fcc90-644a-4967-8154-ac6b45ded2ab tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:47.346136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-213fcc90-644a-4967-8154-ac6b45ded2ab tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.147082 Jun 22 09:12:47.346703 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 372/718] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:47 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:47.372536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7bf8ab1e-bea3-4fd4-9122-0c7224b7d456 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:47.373135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7bf8ab1e-bea3-4fd4-9122-0c7224b7d456 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:47.379070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7bf8ab1e-bea3-4fd4-9122-0c7224b7d456 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.379510 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7bf8ab1e-bea3-4fd4-9122-0c7224b7d456 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:47.380252 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7bf8ab1e-bea3-4fd4-9122-0c7224b7d456 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.380680 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7bf8ab1e-bea3-4fd4-9122-0c7224b7d456 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:47.551543 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7bf8ab1e-bea3-4fd4-9122-0c7224b7d456 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:47.560516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7bf8ab1e-bea3-4fd4-9122-0c7224b7d456 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1508 microversion: 2.1 time: 0.192401 Jun 22 09:12:47.561095 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 373/719] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:47 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:47.889477 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:47.890184 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:47.896619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.897064 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:47.897819 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.898253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:48.026904 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:48.035230 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:48.036727 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:48.037814 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5cf8fb61-031d-4c30-ae0f-6c525837c1b5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.152300 Jun 22 09:12:48.038363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 374/720] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:47 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:48.363222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9f24fe4e-05a8-4987-9d99-9116830954a2 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:48.363822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9f24fe4e-05a8-4987-9d99-9116830954a2 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:48.369822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9f24fe4e-05a8-4987-9d99-9116830954a2 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:48.370257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9f24fe4e-05a8-4987-9d99-9116830954a2 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:48.371028 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9f24fe4e-05a8-4987-9d99-9116830954a2 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:48.371606 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9f24fe4e-05a8-4987-9d99-9116830954a2 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:48.493499 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9f24fe4e-05a8-4987-9d99-9116830954a2 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:48.500703 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9f24fe4e-05a8-4987-9d99-9116830954a2 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.141294 Jun 22 09:12:48.501266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 375/721] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:48 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:48.577706 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-abdfacec-698b-4648-a472-4f3094c7f3d0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:48.578219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-abdfacec-698b-4648-a472-4f3094c7f3d0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:48.584202 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-abdfacec-698b-4648-a472-4f3094c7f3d0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:48.584576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-abdfacec-698b-4648-a472-4f3094c7f3d0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:48.585328 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-abdfacec-698b-4648-a472-4f3094c7f3d0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:48.585752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-abdfacec-698b-4648-a472-4f3094c7f3d0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:48.714170 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-abdfacec-698b-4648-a472-4f3094c7f3d0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:48.721625 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-abdfacec-698b-4648-a472-4f3094c7f3d0 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1508 microversion: 2.1 time: 0.148252 Jun 22 09:12:48.722195 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 376/722] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:48 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:49.056043 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:49.057237 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:49.063393 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.063833 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.064589 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.065018 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.213304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:49.221813 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:49.223368 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:49.224457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a6b8c1b5-7d47-43b2-a0f5-8a612a86818f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.172505 Jun 22 09:12:49.225079 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 377/723] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:49 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:49.518542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-76857c42-3ae3-4248-9e5a-e76bbb6869ae tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:49.519253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-76857c42-3ae3-4248-9e5a-e76bbb6869ae tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:49.526587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76857c42-3ae3-4248-9e5a-e76bbb6869ae tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.527075 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76857c42-3ae3-4248-9e5a-e76bbb6869ae tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.527857 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76857c42-3ae3-4248-9e5a-e76bbb6869ae tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.528301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76857c42-3ae3-4248-9e5a-e76bbb6869ae tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.670211 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-76857c42-3ae3-4248-9e5a-e76bbb6869ae tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:49.678747 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-76857c42-3ae3-4248-9e5a-e76bbb6869ae tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.164237 Jun 22 09:12:49.679596 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 378/724] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:49 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:49.739636 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-aa458b2b-acb8-483d-9a90-4aecbb358341 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:49.740385 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-aa458b2b-acb8-483d-9a90-4aecbb358341 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:49.746485 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-aa458b2b-acb8-483d-9a90-4aecbb358341 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.747045 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-aa458b2b-acb8-483d-9a90-4aecbb358341 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.748339 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-aa458b2b-acb8-483d-9a90-4aecbb358341 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.748779 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-aa458b2b-acb8-483d-9a90-4aecbb358341 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.894047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-aa458b2b-acb8-483d-9a90-4aecbb358341 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:49.901826 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-aa458b2b-acb8-483d-9a90-4aecbb358341 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1508 microversion: 2.1 time: 0.166419 Jun 22 09:12:49.902422 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 379/725] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:49 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:12:49.970622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:50.248450 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:50.251647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:50.258023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.258475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.259284 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.259714 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.410764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:50.418735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:50.420545 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:50.421853 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-96d55093-ec4f-4855-9e6c-dc00df02bd28 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.177833 Jun 22 09:12:50.422419 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 380/726] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:50 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:50.431895 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-7ae67750-3256-47d2-8b1a-f7d35792a3d6 req-57fafeea-cf83-48a6-90d6-5fa0ce00e300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1905450d-b26c-4e46-914b-a6a04d9cc7b1", "name": "network-vif-deleted", "tag": "974e9d62-8fe0-47bd-ad36-3e266d639c90"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:50.436046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e0ce6681-19eb-4db5-b498-39128dc3bee4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.475338 Jun 22 09:12:50.436046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 347/727] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:12:39 2022] POST /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments => generated 194 bytes in 10477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:50.441761 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-7ae67750-3256-47d2-8b1a-f7d35792a3d6 req-57fafeea-cf83-48a6-90d6-5fa0ce00e300 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.441761 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-7ae67750-3256-47d2-8b1a-f7d35792a3d6 req-57fafeea-cf83-48a6-90d6-5fa0ce00e300 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.453200 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-7ae67750-3256-47d2-8b1a-f7d35792a3d6 req-57fafeea-cf83-48a6-90d6-5fa0ce00e300 service nova] Creating event network-vif-deleted:974e9d62-8fe0-47bd-ad36-3e266d639c90 for instance 1905450d-b26c-4e46-914b-a6a04d9cc7b1 on hv-cinder-80382 Jun 22 09:12:50.458129 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-7ae67750-3256-47d2-8b1a-f7d35792a3d6 req-57fafeea-cf83-48a6-90d6-5fa0ce00e300 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032002 Jun 22 09:12:50.459013 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 381/728] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:50.697771 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c7b05d0b-75f3-49bf-a6d2-096cb12e730a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:50.698458 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c7b05d0b-75f3-49bf-a6d2-096cb12e730a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:50.705841 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c7b05d0b-75f3-49bf-a6d2-096cb12e730a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.706287 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c7b05d0b-75f3-49bf-a6d2-096cb12e730a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.707076 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c7b05d0b-75f3-49bf-a6d2-096cb12e730a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.707502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c7b05d0b-75f3-49bf-a6d2-096cb12e730a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.837512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c7b05d0b-75f3-49bf-a6d2-096cb12e730a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:50.845089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c7b05d0b-75f3-49bf-a6d2-096cb12e730a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.151576 Jun 22 09:12:50.845685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 348/729] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:50 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:50.920070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-72b72805-9fbd-421f-b143-67f578d311de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:50.920763 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-72b72805-9fbd-421f-b143-67f578d311de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:50.926876 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-72b72805-9fbd-421f-b143-67f578d311de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.927329 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-72b72805-9fbd-421f-b143-67f578d311de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.928159 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-72b72805-9fbd-421f-b143-67f578d311de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.928595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-72b72805-9fbd-421f-b143-67f578d311de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.932505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=100 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:50.994533 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-72b72805-9fbd-421f-b143-67f578d311de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:51.002144 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-72b72805-9fbd-421f-b143-67f578d311de tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1466 microversion: 2.1 time: 0.086968 Jun 22 09:12:51.002712 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 382/730] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:50 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1466 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:51.440011 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:51.440696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:51.447136 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:51.451289 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:51.451289 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:51.451289 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:51.582579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:51.590442 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:51.592001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:51.593078 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4e57a3dc-e61e-4a15-b77c-58e19b9000d3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.157037 Jun 22 09:12:51.593631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 349/731] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:51 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:51.862110 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d246b76c-cae6-427e-a766-a3e71db1650d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:51.862721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d246b76c-cae6-427e-a766-a3e71db1650d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:51.869376 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d246b76c-cae6-427e-a766-a3e71db1650d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:51.869829 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d246b76c-cae6-427e-a766-a3e71db1650d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:51.870585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d246b76c-cae6-427e-a766-a3e71db1650d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:51.871061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d246b76c-cae6-427e-a766-a3e71db1650d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:51.997237 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d246b76c-cae6-427e-a766-a3e71db1650d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:52.005269 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d246b76c-cae6-427e-a766-a3e71db1650d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.147301 Jun 22 09:12:52.005851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 383/732] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:51 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:52.019532 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5d3ad069-fafe-40cc-a5d5-16f75b89cb8f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:52.020137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5d3ad069-fafe-40cc-a5d5-16f75b89cb8f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:52.026594 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d3ad069-fafe-40cc-a5d5-16f75b89cb8f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:52.027081 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d3ad069-fafe-40cc-a5d5-16f75b89cb8f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:52.027905 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d3ad069-fafe-40cc-a5d5-16f75b89cb8f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:52.028341 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d3ad069-fafe-40cc-a5d5-16f75b89cb8f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:52.103551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5d3ad069-fafe-40cc-a5d5-16f75b89cb8f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:52.112331 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5d3ad069-fafe-40cc-a5d5-16f75b89cb8f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 200 len: 1466 microversion: 2.1 time: 0.096589 Jun 22 09:12:52.121534 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 350/733] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:52 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 1466 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:52.611273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:52.612177 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:52.619232 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:52.619685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:52.620448 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:52.620882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:52.754189 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:52.762172 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:52.764309 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:52.765420 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6ba97d6e-31e2-406f-a6f4-0a6d8682e6c7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.158267 Jun 22 09:12:52.766182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 384/734] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:52 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:53.022962 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7fc99405-c523-4460-a843-7a2f8a49e033 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:53.023578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7fc99405-c523-4460-a843-7a2f8a49e033 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:53.031214 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7fc99405-c523-4460-a843-7a2f8a49e033 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.031658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7fc99405-c523-4460-a843-7a2f8a49e033 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.032467 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7fc99405-c523-4460-a843-7a2f8a49e033 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.032946 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7fc99405-c523-4460-a843-7a2f8a49e033 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.129599 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:53.132734 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: 1905450d-b26c-4e46-914b-a6a04d9cc7b1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:53.137433 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.137914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.138694 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.139277 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.153192 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] HTTP exception thrown: Instance 1905450d-b26c-4e46-914b-a6a04d9cc7b1 could not be found. Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Request method failure captured: Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 HTTP/1.1 Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHffkrcURPh5_p8DJ-OorG_jbpSa-9p7eRx2v0zUADKz4LoPZtA5Q_L-q42DvwL6rJ9BAkjazfPS3Q0VCpFJjRznzp8sl5hkv1cyTFXp8TvntWMEfIgtZqeRDBE9-1QqNO_TS597PJxaXTlyTT82OW19HSLE8KvEstAKAWo3BcBBM Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:12:53.155806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}] Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 71ac6423996b4e5d906de9ff6986fb03 Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 1905450d-b26c-4e46-914b-a6a04d9cc7b1 could not be found. Jun 22 09:12:53.162273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '1905450d-b26c-4e46-914b-a6a04d9cc7b1'} Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1905450d-b26c-4e46-914b-a6a04d9cc7b1 could not be found. Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:12:53.163190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1905450d-b26c-4e46-914b-a6a04d9cc7b1 could not be found. Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1905450d-b26c-4e46-914b-a6a04d9cc7b1 could not be found. Jun 22 09:12:53.164673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:53.166037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Returning 404 to user: Instance 1905450d-b26c-4e46-914b-a6a04d9cc7b1 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:12:53.166037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f475aff8-d829-4c7e-988a-17215aaf4ab3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1" status: 404 len: 111 microversion: 2.1 time: 0.031646 Jun 22 09:12:53.166037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 385/735] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:53 2022] GET /compute/v2.1/servers/1905450d-b26c-4e46-914b-a6a04d9cc7b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:12:53.168586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7fc99405-c523-4460-a843-7a2f8a49e033 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:53.172454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9adb75e8-64d4-4cca-a6be-f89e0f4bc7ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:53.173061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9adb75e8-64d4-4cca-a6be-f89e0f4bc7ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:53.176871 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7fc99405-c523-4460-a843-7a2f8a49e033 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.157816 Jun 22 09:12:53.177444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 351/736] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:53 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:53.179367 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9adb75e8-64d4-4cca-a6be-f89e0f4bc7ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.179807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9adb75e8-64d4-4cca-a6be-f89e0f4bc7ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.180561 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9adb75e8-64d4-4cca-a6be-f89e0f4bc7ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.181024 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9adb75e8-64d4-4cca-a6be-f89e0f4bc7ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.205819 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9adb75e8-64d4-4cca-a6be-f89e0f4bc7ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Going to try to terminate instance {{(pid=118268) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:12:53.502009 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9adb75e8-64d4-4cca-a6be-f89e0f4bc7ca tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 204 len: 0 microversion: 2.1 time: 0.334009 Jun 22 09:12:53.502597 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 386/737] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:12:53 2022] DELETE /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:12:53.510488 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-50298757-3f71-4e0f-9669-0a4bce11290a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:53.511124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-50298757-3f71-4e0f-9669-0a4bce11290a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:53.517580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-50298757-3f71-4e0f-9669-0a4bce11290a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.518026 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-50298757-3f71-4e0f-9669-0a4bce11290a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.518776 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-50298757-3f71-4e0f-9669-0a4bce11290a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.519237 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-50298757-3f71-4e0f-9669-0a4bce11290a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.670726 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-50298757-3f71-4e0f-9669-0a4bce11290a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:53.678795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-50298757-3f71-4e0f-9669-0a4bce11290a tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.172160 Jun 22 09:12:53.679815 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 352/738] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:53 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:53.784469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:53.785104 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:53.791065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.791506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.792273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.792699 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.922103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:53.932228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:53.933716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:53.935389 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a6085488-94c4-4124-902a-ba7c0b807f48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.154653 Jun 22 09:12:53.935906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 387/739] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:53 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:54.193543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8d126794-31bb-4848-97b0-a5be94d590c1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:54.194155 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8d126794-31bb-4848-97b0-a5be94d590c1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:54.201271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d126794-31bb-4848-97b0-a5be94d590c1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:54.201715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d126794-31bb-4848-97b0-a5be94d590c1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:54.202468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d126794-31bb-4848-97b0-a5be94d590c1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:54.202925 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d126794-31bb-4848-97b0-a5be94d590c1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:54.331535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8d126794-31bb-4848-97b0-a5be94d590c1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:54.338795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8d126794-31bb-4848-97b0-a5be94d590c1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.149153 Jun 22 09:12:54.339374 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 353/740] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:54 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:54.695863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0fd2b7d5-01a8-4b63-9fb0-ee010e0f474f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:54.696472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0fd2b7d5-01a8-4b63-9fb0-ee010e0f474f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:54.702925 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0fd2b7d5-01a8-4b63-9fb0-ee010e0f474f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:54.703377 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0fd2b7d5-01a8-4b63-9fb0-ee010e0f474f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:54.704136 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0fd2b7d5-01a8-4b63-9fb0-ee010e0f474f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:54.704571 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0fd2b7d5-01a8-4b63-9fb0-ee010e0f474f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:54.829462 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0fd2b7d5-01a8-4b63-9fb0-ee010e0f474f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:54.836815 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0fd2b7d5-01a8-4b63-9fb0-ee010e0f474f tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.144816 Jun 22 09:12:54.837384 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 388/741] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:54 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:54.953267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:54.954034 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:54.959966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:54.960406 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:54.961154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:54.961590 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:55.090005 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:55.098746 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:55.100264 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:55.101358 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f0c553e8-f828-4ccc-bcd8-e9e3c70caa10 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.152096 Jun 22 09:12:55.101910 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 354/742] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:54 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:55.307828 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-4ca82c9a-adff-4fd3-8035-ac0576d84757 req-6d33e28b-a0db-4648-b0d2-08ac29bd2e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88cfdf9-1c62-4867-ae38-32484e4b2fdd", "name": "network-vif-plugged", "status": "completed", "tag": "80ee4f92-8e74-49ff-9d1e-85edcc14992c"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:55.316587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-4ca82c9a-adff-4fd3-8035-ac0576d84757 req-6d33e28b-a0db-4648-b0d2-08ac29bd2e94 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:55.317032 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-4ca82c9a-adff-4fd3-8035-ac0576d84757 req-6d33e28b-a0db-4648-b0d2-08ac29bd2e94 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:55.329033 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-4ca82c9a-adff-4fd3-8035-ac0576d84757 req-6d33e28b-a0db-4648-b0d2-08ac29bd2e94 service nova] Creating event network-vif-plugged:80ee4f92-8e74-49ff-9d1e-85edcc14992c for instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd on hv-cinder-80382 Jun 22 09:12:55.334705 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-4ca82c9a-adff-4fd3-8035-ac0576d84757 req-6d33e28b-a0db-4648-b0d2-08ac29bd2e94 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089644 Jun 22 09:12:55.335497 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 389/743] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:55.355275 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cd9e7663-702c-4366-9a6d-90f92a16ae03 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:55.355920 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cd9e7663-702c-4366-9a6d-90f92a16ae03 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:55.363326 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd9e7663-702c-4366-9a6d-90f92a16ae03 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:55.363778 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd9e7663-702c-4366-9a6d-90f92a16ae03 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:55.364553 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd9e7663-702c-4366-9a6d-90f92a16ae03 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:55.364987 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd9e7663-702c-4366-9a6d-90f92a16ae03 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:55.496879 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cd9e7663-702c-4366-9a6d-90f92a16ae03 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:55.504774 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cd9e7663-702c-4366-9a6d-90f92a16ae03 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.153651 Jun 22 09:12:55.505374 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 355/744] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:55 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:55.854155 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4eb6ce27-e1a0-4281-b7fa-e4d18bf77d85 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:55.854865 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4eb6ce27-e1a0-4281-b7fa-e4d18bf77d85 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:55.863040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4eb6ce27-e1a0-4281-b7fa-e4d18bf77d85 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:55.863481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4eb6ce27-e1a0-4281-b7fa-e4d18bf77d85 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:55.864310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4eb6ce27-e1a0-4281-b7fa-e4d18bf77d85 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:55.864746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4eb6ce27-e1a0-4281-b7fa-e4d18bf77d85 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:55.999701 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4eb6ce27-e1a0-4281-b7fa-e4d18bf77d85 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:56.007298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4eb6ce27-e1a0-4281-b7fa-e4d18bf77d85 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1521 microversion: 2.1 time: 0.157544 Jun 22 09:12:56.007864 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 390/745] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:55 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:56.119644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:56.120329 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:56.127354 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:56.128014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:56.128800 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:56.129238 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:56.338439 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:56.345569 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:56.347115 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:56.348407 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2b0af8a6-ac90-4bcc-b90f-57b8b42d069a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.232759 Jun 22 09:12:56.349311 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 356/746] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:56 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:56.523090 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-13d86baa-216a-4013-bced-11ac9cf8e546 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:56.523651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-13d86baa-216a-4013-bced-11ac9cf8e546 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:56.530171 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-13d86baa-216a-4013-bced-11ac9cf8e546 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:56.530618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-13d86baa-216a-4013-bced-11ac9cf8e546 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:56.531423 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-13d86baa-216a-4013-bced-11ac9cf8e546 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:56.531838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-13d86baa-216a-4013-bced-11ac9cf8e546 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:56.657794 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-13d86baa-216a-4013-bced-11ac9cf8e546 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:56.665169 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-13d86baa-216a-4013-bced-11ac9cf8e546 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.146073 Jun 22 09:12:56.665732 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 391/747] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:56 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:56.762600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-61c0e476-db03-444f-97b4-b5267438845a req-fda46085-c4b7-4ea1-9500-16acf9f3f14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf015553-3a8f-459a-a15a-f269b6d3dae6", "name": "network-vif-deleted", "tag": "0ae128fa-373b-4d19-b6a6-ca5d9a45df96"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:56.772052 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-61c0e476-db03-444f-97b4-b5267438845a req-fda46085-c4b7-4ea1-9500-16acf9f3f14e service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:56.772618 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-61c0e476-db03-444f-97b4-b5267438845a req-fda46085-c4b7-4ea1-9500-16acf9f3f14e service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:56.784106 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-61c0e476-db03-444f-97b4-b5267438845a req-fda46085-c4b7-4ea1-9500-16acf9f3f14e service nova] Creating event network-vif-deleted:0ae128fa-373b-4d19-b6a6-ca5d9a45df96 for instance cf015553-3a8f-459a-a15a-f269b6d3dae6 on hv-cinder-80382 Jun 22 09:12:56.788900 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-61c0e476-db03-444f-97b4-b5267438845a req-fda46085-c4b7-4ea1-9500-16acf9f3f14e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029974 Jun 22 09:12:56.789492 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 357/748] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:57.024290 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2de6f7a7-5471-4bb1-be1c-0ac01bf5f4b3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:57.024979 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2de6f7a7-5471-4bb1-be1c-0ac01bf5f4b3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:57.031858 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2de6f7a7-5471-4bb1-be1c-0ac01bf5f4b3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:57.038729 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2de6f7a7-5471-4bb1-be1c-0ac01bf5f4b3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:57.038729 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2de6f7a7-5471-4bb1-be1c-0ac01bf5f4b3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:57.038729 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2de6f7a7-5471-4bb1-be1c-0ac01bf5f4b3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:57.342924 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2de6f7a7-5471-4bb1-be1c-0ac01bf5f4b3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:57.349578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-7e27189f-8d2f-42a5-967e-f3811ba89421 req-f6fb20d4-7add-474c-8f0c-ac7dcae864ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93eaaa7c-1a8d-404e-9194-0ef4556feee7", "name": "network-vif-plugged", "status": "completed", "tag": "687407a6-7cc6-4eaa-a14c-ef82cef3aa05"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:57.351011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2de6f7a7-5471-4bb1-be1c-0ac01bf5f4b3 tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1479 microversion: 2.1 time: 0.330441 Jun 22 09:12:57.351601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 392/749] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:57 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1479 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:57.360216 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-7e27189f-8d2f-42a5-967e-f3811ba89421 req-f6fb20d4-7add-474c-8f0c-ac7dcae864ba service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:57.361505 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-7e27189f-8d2f-42a5-967e-f3811ba89421 req-f6fb20d4-7add-474c-8f0c-ac7dcae864ba service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:57.367416 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:57.368029 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:57.376364 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:57.376817 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:57.377590 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:57.377730 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-7e27189f-8d2f-42a5-967e-f3811ba89421 req-f6fb20d4-7add-474c-8f0c-ac7dcae864ba service nova] Creating event network-vif-plugged:687407a6-7cc6-4eaa-a14c-ef82cef3aa05 for instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 on hv-cinder-80382 Jun 22 09:12:57.378027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:57.384073 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-7e27189f-8d2f-42a5-967e-f3811ba89421 req-f6fb20d4-7add-474c-8f0c-ac7dcae864ba service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038221 Jun 22 09:12:57.384687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 358/750] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:12:57.507556 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:57.515592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:57.517106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:57.518259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-847e2455-b7b9-4e80-8c6c-62463cb007e0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1405 microversion: 2.20 time: 0.154711 Jun 22 09:12:57.518805 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 393/751] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:57 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:12:57.681935 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fb054c21-cf5f-470c-b675-6ab2c602dbf1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:57.682680 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fb054c21-cf5f-470c-b675-6ab2c602dbf1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:57.689466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fb054c21-cf5f-470c-b675-6ab2c602dbf1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:57.689908 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fb054c21-cf5f-470c-b675-6ab2c602dbf1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:57.690659 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fb054c21-cf5f-470c-b675-6ab2c602dbf1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:57.691121 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fb054c21-cf5f-470c-b675-6ab2c602dbf1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:57.817682 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fb054c21-cf5f-470c-b675-6ab2c602dbf1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:57.825083 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fb054c21-cf5f-470c-b675-6ab2c602dbf1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.147348 Jun 22 09:12:57.826233 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 359/752] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:57 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:58.368396 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:58.369685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:58.376148 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.376592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.377354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.377782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.408201 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.408647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.409086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lazy-loading 'fault' on Instance uuid cf015553-3a8f-459a-a15a-f269b6d3dae6 {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:12:58.451270 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ac6423996b4e5d906de9ff6986fb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1c1626dad34ae9a2216e46ffae4003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:58.459193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-551dcb83-9dcc-4b81-9922-a88df6a52dce tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 200 len: 1312 microversion: 2.1 time: 0.094544 Jun 22 09:12:58.459765 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 394/753] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:58 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:58.535984 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:58.536579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:58.542607 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.543151 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.543896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.544900 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.677189 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:58.685124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:58.686625 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:58.687787 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9de6ecce-8030-4ca6-b2dc-976572993bee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1598 microversion: 2.20 time: 0.155683 Jun 22 09:12:58.688346 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 360/754] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:12:58 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:12:58.704688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e761a7b6-2c2c-4f58-92b0-267c1b53fac0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:58.705184 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e761a7b6-2c2c-4f58-92b0-267c1b53fac0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:58.711190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e761a7b6-2c2c-4f58-92b0-267c1b53fac0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.711641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e761a7b6-2c2c-4f58-92b0-267c1b53fac0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.712394 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e761a7b6-2c2c-4f58-92b0-267c1b53fac0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.712824 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e761a7b6-2c2c-4f58-92b0-267c1b53fac0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.792354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e761a7b6-2c2c-4f58-92b0-267c1b53fac0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091524 Jun 22 09:12:58.793553 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 395/755] 10.222.0.55 () {60 vars in 1315 bytes} [Wed Jun 22 09:12:58 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:12:58.842772 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-17566b30-4271-4ddb-8fec-e874a533f962 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:58.849543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-17566b30-4271-4ddb-8fec-e874a533f962 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:58.850724 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-17566b30-4271-4ddb-8fec-e874a533f962 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.851266 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-17566b30-4271-4ddb-8fec-e874a533f962 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:58.852037 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-17566b30-4271-4ddb-8fec-e874a533f962 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:58.853471 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-17566b30-4271-4ddb-8fec-e874a533f962 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:59.008075 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-17566b30-4271-4ddb-8fec-e874a533f962 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:59.012595 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:59.016413 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-17566b30-4271-4ddb-8fec-e874a533f962 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.178285 Jun 22 09:12:59.016986 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 361/756] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:58 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:59.477542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:59.478599 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] [instance: cf015553-3a8f-459a-a15a-f269b6d3dae6] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:59.485100 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:59.485542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:59.486296 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:59.486838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:59.502112 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] HTTP exception thrown: Instance cf015553-3a8f-459a-a15a-f269b6d3dae6 could not be found. Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Request method failure captured: Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 HTTP/1.1 Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHffkrcURPh5_p8DJ-OorG_jbpSa-9p7eRx2v0zUADKz4LoPZtA5Q_L-q42DvwL6rJ9BAkjazfPS3Q0VCpFJjRznzp8sl5hkv1cyTFXp8TvntWMEfIgtZqeRDBE9-1QqNO_TS597PJxaXTlyTT82OW19HSLE8KvEstAKAWo3BcBBM Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:12:59.517457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aa1c1626dad34ae9a2216e46ffae4003"}]}] Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: aa1c1626dad34ae9a2216e46ffae4003 Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1812605216 Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 71ac6423996b4e5d906de9ff6986fb03 Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1812605216-project Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance cf015553-3a8f-459a-a15a-f269b6d3dae6 could not be found. Jun 22 09:12:59.518869 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'cf015553-3a8f-459a-a15a-f269b6d3dae6'} Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf015553-3a8f-459a-a15a-f269b6d3dae6 could not be found. Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:12:59.519741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf015553-3a8f-459a-a15a-f269b6d3dae6 could not be found. Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf015553-3a8f-459a-a15a-f269b6d3dae6 could not be found. Jun 22 09:12:59.520887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:12:59.521942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] Returning 404 to user: Instance cf015553-3a8f-459a-a15a-f269b6d3dae6 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:12:59.521942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e2413c2d-91de-4d09-a219-372ff7954a9c tempest-ServerRescueNegativeTestJSON-1812605216 tempest-ServerRescueNegativeTestJSON-1812605216-project] 10.222.0.55 "GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6" status: 404 len: 111 microversion: 2.1 time: 0.045849 Jun 22 09:12:59.521942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 396/757] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:59 2022] GET /compute/v2.1/servers/cf015553-3a8f-459a-a15a-f269b6d3dae6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:12:59.923799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-4f8493e2-fff3-497a-8169-1d81943abbf8 req-359bfae3-60d5-402a-bf34-df7dbb63f205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88cfdf9-1c62-4867-ae38-32484e4b2fdd", "tag": "80ee4f92-8e74-49ff-9d1e-85edcc14992c"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:59.944816 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-4f8493e2-fff3-497a-8169-1d81943abbf8 req-359bfae3-60d5-402a-bf34-df7dbb63f205 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:59.945540 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-4f8493e2-fff3-497a-8169-1d81943abbf8 req-359bfae3-60d5-402a-bf34-df7dbb63f205 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:59.959641 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-4f8493e2-fff3-497a-8169-1d81943abbf8 req-359bfae3-60d5-402a-bf34-df7dbb63f205 service nova] Creating event network-changed:80ee4f92-8e74-49ff-9d1e-85edcc14992c for instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd on hv-cinder-80382 Jun 22 09:12:59.965199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-4f8493e2-fff3-497a-8169-1d81943abbf8 req-359bfae3-60d5-402a-bf34-df7dbb63f205 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112041 Jun 22 09:12:59.966606 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 362/758] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:00.033388 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4ecdf4cf-4799-440a-afb3-6611e17c424a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:00.034279 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4ecdf4cf-4799-440a-afb3-6611e17c424a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:00.040771 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4ecdf4cf-4799-440a-afb3-6611e17c424a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:00.041439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4ecdf4cf-4799-440a-afb3-6611e17c424a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:00.042585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4ecdf4cf-4799-440a-afb3-6611e17c424a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:00.043070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4ecdf4cf-4799-440a-afb3-6611e17c424a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:00.199994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4ecdf4cf-4799-440a-afb3-6611e17c424a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:00.210773 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4ecdf4cf-4799-440a-afb3-6611e17c424a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1357 microversion: 2.1 time: 0.181110 Jun 22 09:13:00.220285 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 397/759] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:00 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:01.139903 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5202f955-1710-4861-9a7d-b51b214ee24a"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:01.146112 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:01.154055 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.154520 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.155321 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.155761 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.227026 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8efa3f68-6c48-4721-8aa0-b01c891f9e42 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:01.227636 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8efa3f68-6c48-4721-8aa0-b01c891f9e42 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:01.234485 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8efa3f68-6c48-4721-8aa0-b01c891f9e42 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.234977 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8efa3f68-6c48-4721-8aa0-b01c891f9e42 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.236010 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8efa3f68-6c48-4721-8aa0-b01c891f9e42 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.236450 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8efa3f68-6c48-4721-8aa0-b01c891f9e42 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.249895 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Invalid volume: volume 5202f955-1710-4861-9a7d-b51b214ee24a is already attached to instances: cfc86b4e-da76-47e9-9481-0297e22fb98e Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: POST /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments HTTP/1.1 Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 74 Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:13:01.251648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {"volumeAttachment": {"volumeId": "5202f955-1710-4861-9a7d-b51b214ee24a"}} Jun 22 09:13:01.252981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Invalid volume: volume 5202f955-1710-4861-9a7d-b51b214ee24a is already attached to instances: cfc86b4e-da76-47e9-9481-0297e22fb98e Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'server_id': 'cfc86b4e-da76-47e9-9481-0297e22fb98e', 'body': {'volumeAttachment': {'volumeId': '5202f955-1710-4861-9a7d-b51b214ee24a'}}} Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5202f955-1710-4861-9a7d-b51b214ee24a is already attached to instances: cfc86b4e-da76-47e9-9481-0297e22fb98e Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:01.253701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5202f955-1710-4861-9a7d-b51b214ee24a is already attached to instances: cfc86b4e-da76-47e9-9481-0297e22fb98e Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:01.254880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:01.256098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:01.256098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:01.256098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:01.256098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5202f955-1710-4861-9a7d-b51b214ee24a is already attached to instances: cfc86b4e-da76-47e9-9481-0297e22fb98e Jun 22 09:13:01.256098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:01.256098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 400 to user: Invalid volume: volume 5202f955-1710-4861-9a7d-b51b214ee24a is already attached to instances: cfc86b4e-da76-47e9-9481-0297e22fb98e {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:01.256098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-90692260-c4d7-4ecd-88c9-2d9991770fd7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119317 Jun 22 09:13:01.256098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 363/760] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:13:01 2022] POST /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:13:01.318795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-de30e35c-4997-4f1d-bf45-6ab1b1b5017a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:01.319556 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-de30e35c-4997-4f1d-bf45-6ab1b1b5017a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:01.326522 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-de30e35c-4997-4f1d-bf45-6ab1b1b5017a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.327260 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-de30e35c-4997-4f1d-bf45-6ab1b1b5017a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.328420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-de30e35c-4997-4f1d-bf45-6ab1b1b5017a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.329019 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-de30e35c-4997-4f1d-bf45-6ab1b1b5017a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.385337 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8efa3f68-6c48-4721-8aa0-b01c891f9e42 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:01.393972 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8efa3f68-6c48-4721-8aa0-b01c891f9e42 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1548 microversion: 2.1 time: 0.170574 Jun 22 09:13:01.394721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 398/761] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:01 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:01.410603 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f0a4fd06-4de6-4159-835a-3f9794c13762 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:01.411237 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f0a4fd06-4de6-4159-835a-3f9794c13762 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:01.417352 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f0a4fd06-4de6-4159-835a-3f9794c13762 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.418032 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f0a4fd06-4de6-4159-835a-3f9794c13762 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.419043 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f0a4fd06-4de6-4159-835a-3f9794c13762 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.419628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f0a4fd06-4de6-4159-835a-3f9794c13762 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.424381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:01.426961 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-de30e35c-4997-4f1d-bf45-6ab1b1b5017a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'services' on Instance uuid cfc86b4e-da76-47e9-9481-0297e22fb98e {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:13:01.571129 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f0a4fd06-4de6-4159-835a-3f9794c13762 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:01.579786 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f0a4fd06-4de6-4159-835a-3f9794c13762 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1548 microversion: 2.1 time: 0.172882 Jun 22 09:13:01.580384 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 399/762] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:01 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:01.595878 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f8a7348b-e2ed-4401-8666-faa90d620fac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:01.599718 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f8a7348b-e2ed-4401-8666-faa90d620fac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:01.600507 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f8a7348b-e2ed-4401-8666-faa90d620fac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Searching by: {'deleted': False, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6'} {{(pid=118268) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 09:13:01.607679 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f8a7348b-e2ed-4401-8666-faa90d620fac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.608125 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f8a7348b-e2ed-4401-8666-faa90d620fac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.608916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f8a7348b-e2ed-4401-8666-faa90d620fac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.609363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f8a7348b-e2ed-4401-8666-faa90d620fac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.700269 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.multi_cell_list [None req-f8a7348b-e2ed-4401-8666-faa90d620fac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118268) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 09:13:01.731924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-de30e35c-4997-4f1d-bf45-6ab1b1b5017a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments/5202f955-1710-4861-9a7d-b51b214ee24a" status: 202 len: 0 microversion: 2.1 time: 0.416865 Jun 22 09:13:01.733448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 364/763] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:13:01 2022] DELETE /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments/5202f955-1710-4861-9a7d-b51b214ee24a => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:13:01.756291 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9138a450-dca2-47a3-878e-454c4e01cdf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:01.760244 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9138a450-dca2-47a3-878e-454c4e01cdf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:01.768776 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9138a450-dca2-47a3-878e-454c4e01cdf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.769515 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9138a450-dca2-47a3-878e-454c4e01cdf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.770355 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9138a450-dca2-47a3-878e-454c4e01cdf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.770919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9138a450-dca2-47a3-878e-454c4e01cdf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.801026 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f8a7348b-e2ed-4401-8666-faa90d620fac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208942 Jun 22 09:13:01.802179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 400/764] 10.222.0.55 () {58 vars in 1124 bytes} [Wed Jun 22 09:13:01 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:13:01.804070 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9138a450-dca2-47a3-878e-454c4e01cdf7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065832 Jun 22 09:13:01.804882 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 365/765] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:01 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:01.815598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4f53fba3-def6-4f4a-94d1-c1cdda32176d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:01.816210 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4f53fba3-def6-4f4a-94d1-c1cdda32176d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:01.822134 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f53fba3-def6-4f4a-94d1-c1cdda32176d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.822585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f53fba3-def6-4f4a-94d1-c1cdda32176d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.823382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f53fba3-def6-4f4a-94d1-c1cdda32176d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:01.823822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f53fba3-def6-4f4a-94d1-c1cdda32176d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:01.972169 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4f53fba3-def6-4f4a-94d1-c1cdda32176d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:01.980773 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4f53fba3-def6-4f4a-94d1-c1cdda32176d tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1548 microversion: 2.1 time: 0.168927 Jun 22 09:13:01.992987 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 401/766] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:01 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:02.817543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6c8eecd8-d869-4337-a588-6ba616c9070c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:02.819340 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6c8eecd8-d869-4337-a588-6ba616c9070c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:02.825728 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6c8eecd8-d869-4337-a588-6ba616c9070c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:02.826211 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6c8eecd8-d869-4337-a588-6ba616c9070c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:02.827024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6c8eecd8-d869-4337-a588-6ba616c9070c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:02.827643 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6c8eecd8-d869-4337-a588-6ba616c9070c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:02.859284 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6c8eecd8-d869-4337-a588-6ba616c9070c tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046583 Jun 22 09:13:02.859831 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 366/767] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:02 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:03.870655 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b90950f5-4ca8-46b9-b373-bc5cc1247d06 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:03.871771 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b90950f5-4ca8-46b9-b373-bc5cc1247d06 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:03.879006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b90950f5-4ca8-46b9-b373-bc5cc1247d06 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:03.879453 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b90950f5-4ca8-46b9-b373-bc5cc1247d06 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:03.880214 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b90950f5-4ca8-46b9-b373-bc5cc1247d06 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:03.880651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b90950f5-4ca8-46b9-b373-bc5cc1247d06 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:03.911620 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b90950f5-4ca8-46b9-b373-bc5cc1247d06 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044856 Jun 22 09:13:03.917340 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 402/768] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:03 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:13:03.917476 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e4980fc1-d3a2-4ed0-b29b-39e6d276db31 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:03.917476 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e4980fc1-d3a2-4ed0-b29b-39e6d276db31 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:03.923505 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e4980fc1-d3a2-4ed0-b29b-39e6d276db31 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:03.923962 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e4980fc1-d3a2-4ed0-b29b-39e6d276db31 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:03.925012 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e4980fc1-d3a2-4ed0-b29b-39e6d276db31 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:03.925457 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e4980fc1-d3a2-4ed0-b29b-39e6d276db31 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:03.985401 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ac6a71a4-a726-4200-b2e4-a981b76d2da8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:03.985902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ac6a71a4-a726-4200-b2e4-a981b76d2da8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:03.992557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac6a71a4-a726-4200-b2e4-a981b76d2da8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:03.993010 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac6a71a4-a726-4200-b2e4-a981b76d2da8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:03.995472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac6a71a4-a726-4200-b2e4-a981b76d2da8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:03.995472 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac6a71a4-a726-4200-b2e4-a981b76d2da8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:04.023518 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ac6a71a4-a726-4200-b2e4-a981b76d2da8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Going to try to terminate instance {{(pid=118268) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:13:04.300758 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ac6a71a4-a726-4200-b2e4-a981b76d2da8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 204 len: 0 microversion: 2.1 time: 0.319254 Jun 22 09:13:04.301351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 403/769] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:13:03 2022] DELETE /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:13:04.311703 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-54e96ebf-80da-4043-bc07-f08b4cd1b8e8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:04.312394 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-54e96ebf-80da-4043-bc07-f08b4cd1b8e8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:04.318209 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-54e96ebf-80da-4043-bc07-f08b4cd1b8e8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:04.318685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-54e96ebf-80da-4043-bc07-f08b4cd1b8e8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:04.319666 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-54e96ebf-80da-4043-bc07-f08b4cd1b8e8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:04.320126 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-54e96ebf-80da-4043-bc07-f08b4cd1b8e8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:04.456130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-54e96ebf-80da-4043-bc07-f08b4cd1b8e8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:04.463652 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-54e96ebf-80da-4043-bc07-f08b4cd1b8e8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1681 microversion: 2.1 time: 0.156616 Jun 22 09:13:04.464247 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 404/770] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:04 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:04.694144 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e4980fc1-d3a2-4ed0-b29b-39e6d276db31 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "POST /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784342 Jun 22 09:13:04.694747 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 367/771] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:13:03 2022] POST /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:05.481719 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e765e306-926b-4c8e-ae64-c2eaf4cc2478 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:05.486017 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e765e306-926b-4c8e-ae64-c2eaf4cc2478 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:05.488727 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e765e306-926b-4c8e-ae64-c2eaf4cc2478 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:05.489179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e765e306-926b-4c8e-ae64-c2eaf4cc2478 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:05.489941 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e765e306-926b-4c8e-ae64-c2eaf4cc2478 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:05.490380 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e765e306-926b-4c8e-ae64-c2eaf4cc2478 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:05.623410 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e765e306-926b-4c8e-ae64-c2eaf4cc2478 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:05.631139 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e765e306-926b-4c8e-ae64-c2eaf4cc2478 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1681 microversion: 2.1 time: 0.153499 Jun 22 09:13:05.631705 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 405/772] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:05 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:06.021871 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5b674f50-d500-4c3f-9934-5d5cb6d8812f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:06.022479 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5b674f50-d500-4c3f-9934-5d5cb6d8812f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:06.029116 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5b674f50-d500-4c3f-9934-5d5cb6d8812f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:06.029559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5b674f50-d500-4c3f-9934-5d5cb6d8812f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:06.030343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5b674f50-d500-4c3f-9934-5d5cb6d8812f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:06.030768 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5b674f50-d500-4c3f-9934-5d5cb6d8812f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:06.055923 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-5b674f50-d500-4c3f-9934-5d5cb6d8812f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lazy-loading 'flavor' on Instance uuid a8edf80c-1741-417f-ad42-4cdf4567898f {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:13:06.352122 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5b674f50-d500-4c3f-9934-5d5cb6d8812f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "POST /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f/action" status: 202 len: 0 microversion: 2.1 time: 0.334893 Jun 22 09:13:06.352919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 368/773] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:13:06 2022] POST /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:13:06.362391 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-669a2c7a-af0b-4819-bf4e-839ca059e20b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:06.363514 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-669a2c7a-af0b-4819-bf4e-839ca059e20b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:06.369579 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-669a2c7a-af0b-4819-bf4e-839ca059e20b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:06.370015 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-669a2c7a-af0b-4819-bf4e-839ca059e20b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:06.370774 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-669a2c7a-af0b-4819-bf4e-839ca059e20b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:06.371335 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-669a2c7a-af0b-4819-bf4e-839ca059e20b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:06.504646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-669a2c7a-af0b-4819-bf4e-839ca059e20b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:06.512998 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-669a2c7a-af0b-4819-bf4e-839ca059e20b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.155289 Jun 22 09:13:06.514652 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 406/774] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:06 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:06.649424 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b9fff358-58bf-4f5d-a6b2-3c69062f3a23 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:06.650191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b9fff358-58bf-4f5d-a6b2-3c69062f3a23 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:06.656910 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b9fff358-58bf-4f5d-a6b2-3c69062f3a23 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:06.657366 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b9fff358-58bf-4f5d-a6b2-3c69062f3a23 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:06.658124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b9fff358-58bf-4f5d-a6b2-3c69062f3a23 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:06.658559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b9fff358-58bf-4f5d-a6b2-3c69062f3a23 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:06.730590 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b9fff358-58bf-4f5d-a6b2-3c69062f3a23 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:06.739724 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b9fff358-58bf-4f5d-a6b2-3c69062f3a23 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1614 microversion: 2.1 time: 0.094699 Jun 22 09:13:06.740295 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 369/775] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:06 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:07.032613 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-aa59081f-4b2b-4607-96ff-30605fa281f0 req-44422194-17bb-4a2e-9230-cc1eb29cd4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc86b4e-da76-47e9-9481-0297e22fb98e", "name": "network-vif-deleted", "tag": "6740c88c-c40a-42ad-9c39-e0f77f8360d2"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:07.041429 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-aa59081f-4b2b-4607-96ff-30605fa281f0 req-44422194-17bb-4a2e-9230-cc1eb29cd4fc service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:07.041922 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-aa59081f-4b2b-4607-96ff-30605fa281f0 req-44422194-17bb-4a2e-9230-cc1eb29cd4fc service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:07.053439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-aa59081f-4b2b-4607-96ff-30605fa281f0 req-44422194-17bb-4a2e-9230-cc1eb29cd4fc service nova] Creating event network-vif-deleted:6740c88c-c40a-42ad-9c39-e0f77f8360d2 for instance cfc86b4e-da76-47e9-9481-0297e22fb98e on hv-cinder-80382 Jun 22 09:13:07.058458 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-aa59081f-4b2b-4607-96ff-30605fa281f0 req-44422194-17bb-4a2e-9230-cc1eb29cd4fc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030954 Jun 22 09:13:07.059297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 407/776] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:07.175586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-dbb8b6fa-59f6-42f3-820b-a1cd9b0d94c1 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e25ff70>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:07.234053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-dbb8b6fa-59f6-42f3-820b-a1cd9b0d94c1 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/6ce61bc4-a758-41d9-9117-0c605347c31c" status: 200 len: 350 microversion: 2.1 time: 0.062257 Jun 22 09:13:07.234649 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 370/777] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:13:07 2022] GET /compute/v2.1/os-volumes/6ce61bc4-a758-41d9-9117-0c605347c31c => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:07.534524 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d2436ec0-b9f7-4c9f-9709-e544fe0fa70b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:07.535335 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d2436ec0-b9f7-4c9f-9709-e544fe0fa70b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:07.542123 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d2436ec0-b9f7-4c9f-9709-e544fe0fa70b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:07.542576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d2436ec0-b9f7-4c9f-9709-e544fe0fa70b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:07.543418 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d2436ec0-b9f7-4c9f-9709-e544fe0fa70b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:07.543872 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d2436ec0-b9f7-4c9f-9709-e544fe0fa70b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:07.684012 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d2436ec0-b9f7-4c9f-9709-e544fe0fa70b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:07.692983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d2436ec0-b9f7-4c9f-9709-e544fe0fa70b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.164543 Jun 22 09:13:07.693681 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 408/778] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:07 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:07.757539 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:07.757539 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:07.763874 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:07.764250 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:07.765022 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:07.765448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:07.799442 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:07.799885 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:07.800304 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'fault' on Instance uuid cfc86b4e-da76-47e9-9481-0297e22fb98e {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:13:07.858417 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:07.876555 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-eadeb392-3d7a-4f82-b239-a2e2dc3874b9 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 200 len: 1331 microversion: 2.1 time: 0.124511 Jun 22 09:13:07.877146 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 371/779] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:07 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:08.710909 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-27e579dc-eff1-40c8-a271-e6cc9fa9cea4 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:08.711518 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-27e579dc-eff1-40c8-a271-e6cc9fa9cea4 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:08.717942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27e579dc-eff1-40c8-a271-e6cc9fa9cea4 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:08.718387 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27e579dc-eff1-40c8-a271-e6cc9fa9cea4 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:08.719191 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27e579dc-eff1-40c8-a271-e6cc9fa9cea4 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:08.719628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27e579dc-eff1-40c8-a271-e6cc9fa9cea4 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:08.815875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b03fb8ed-b797-43a9-8ce4-cc7cd9190e01 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e25fdc0>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:08.848904 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27e579dc-eff1-40c8-a271-e6cc9fa9cea4 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:08.856447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-27e579dc-eff1-40c8-a271-e6cc9fa9cea4 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.149431 Jun 22 09:13:08.857005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 409/780] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:08 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:08.863653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b03fb8ed-b797-43a9-8ce4-cc7cd9190e01 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/bd894f8e-7802-40c9-8014-c93f7d5354d1" status: 200 len: 350 microversion: 2.1 time: 0.051439 Jun 22 09:13:08.864218 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 372/781] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:13:08 2022] GET /compute/v2.1/os-volumes/bd894f8e-7802-40c9-8014-c93f7d5354d1 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:13:08.893190 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:08.893820 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:08.899835 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:08.900270 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:08.901012 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:08.901439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:08.915028 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e HTTP/1.1 Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:13:08.916624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:13:08.918135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'cfc86b4e-da76-47e9-9481-0297e22fb98e'} Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:08.918993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:13:08.920950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:08.922112 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:08.922112 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-52f4cb89-f4e4-49b7-9933-188a5c545fca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 404 len: 111 microversion: 2.1 time: 0.028585 Jun 22 09:13:08.922112 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 410/782] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:08 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:13:08.927471 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ffb64fd9-2014-43d6-8bb3-2c918de9f936 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '.version_select at 0x7f500e30d8b0>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:08.988830 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ffb64fd9-2014-43d6-8bb3-2c918de9f936 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732233921" status: 202 len: 0 microversion: 2.1 time: 0.065064 Jun 22 09:13:08.989425 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 373/783] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 22 09:13:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732233921 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:13:09.702378 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-51afe43b-f263-4dab-a6b9-40ed60e12ed7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:09.702903 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-51afe43b-f263-4dab-a6b9-40ed60e12ed7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:09.709174 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-51afe43b-f263-4dab-a6b9-40ed60e12ed7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:09.709625 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-51afe43b-f263-4dab-a6b9-40ed60e12ed7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:09.710393 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-51afe43b-f263-4dab-a6b9-40ed60e12ed7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:09.710862 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-51afe43b-f263-4dab-a6b9-40ed60e12ed7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:09.735529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-51afe43b-f263-4dab-a6b9-40ed60e12ed7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/ips" status: 200 len: 146 microversion: 2.1 time: 0.037621 Jun 22 09:13:09.741165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 411/784] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:13:09 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:09.791904 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-57197c1e-2d1f-44d5-874e-7f921049cbea tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: .version_select at 0x7f500e385f70>, body: {"keypair": {"name": "tempest-keypair-475260229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzBp4RGvAANAKotfDUOxJDVmQCjnt9Dw3sZF3ao4QlBP7FLP2sxR9ssY/9evLhAFaBC6sWQBjrNmm4lP6bhjqEGwPGKocvtpNpx9uNvOwBCqEEmWMIuHKb7/A7eccuhRQ=="}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:09.806363 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-57197c1e-2d1f-44d5-874e-7f921049cbea tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:13:09.812116 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-57197c1e-2d1f-44d5-874e-7f921049cbea tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for user 0673a8903f56430f86f87b9447668300 and project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:13:09.874892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2ad4edd3-2a45-4b88-8089-b250c1d3def7 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:09.875126 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-57197c1e-2d1f-44d5-874e-7f921049cbea tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086828 Jun 22 09:13:09.875609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2ad4edd3-2a45-4b88-8089-b250c1d3def7 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:09.875775 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 374/785] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:13:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:09.881586 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ad4edd3-2a45-4b88-8089-b250c1d3def7 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:09.883901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ad4edd3-2a45-4b88-8089-b250c1d3def7 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:09.883901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ad4edd3-2a45-4b88-8089-b250c1d3def7 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:09.883901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2ad4edd3-2a45-4b88-8089-b250c1d3def7 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:10.017641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2ad4edd3-2a45-4b88-8089-b250c1d3def7 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:10.028759 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2ad4edd3-2a45-4b88-8089-b250c1d3def7 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.158580 Jun 22 09:13:10.030628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 412/786] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:09 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:10.529933 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-128a698f-47fc-4169-87e4-e9e2839d37e2 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e385e50>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:10.577762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-128a698f-47fc-4169-87e4-e9e2839d37e2 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/43805b49-6edb-4ef1-b4ed-324e0fcb1e73" status: 200 len: 350 microversion: 2.1 time: 0.052316 Jun 22 09:13:10.578347 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 375/787] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:13:10 2022] GET /compute/v2.1/os-volumes/43805b49-6edb-4ef1-b4ed-324e0fcb1e73 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:10.589309 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bbc943a9-ba1a-489f-9f59-4b12068bf8a6 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e1fb280>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:10.671040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bbc943a9-ba1a-489f-9f59-4b12068bf8a6 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.084600 Jun 22 09:13:10.671659 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 413/788] 10.222.0.55 () {58 vars in 1133 bytes} [Wed Jun 22 09:13:10 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:10.683751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1dcd4746-730c-42d8-9883-a1733162e2f9 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e25fb80>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:10.768379 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1dcd4746-730c-42d8-9883-a1733162e2f9 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088533 Jun 22 09:13:10.768947 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 376/789] 10.222.0.55 () {58 vars in 1148 bytes} [Wed Jun 22 09:13:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:10.781793 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9ea3a9b9-2587-454b-9ec3-f11219994bb0 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e3bf1f0>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:10.862519 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9ea3a9b9-2587-454b-9ec3-f11219994bb0 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.085546 Jun 22 09:13:10.863782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 414/790] 10.222.0.55 () {58 vars in 1133 bytes} [Wed Jun 22 09:13:10 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:10.875044 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-45350333-0310-435e-a5b0-8741100959d5 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e30d040>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:10.955817 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-45350333-0310-435e-a5b0-8741100959d5 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085095 Jun 22 09:13:10.956428 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 377/791] 10.222.0.55 () {58 vars in 1166 bytes} [Wed Jun 22 09:13:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:10.968451 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0de525ac-b59a-4c23-b6db-b3461f95eea6 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e3bf4c0>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:11.047122 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8e37452a-05a9-4701-ab41-93615fc75264 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:11.047678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8e37452a-05a9-4701-ab41-93615fc75264 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:11.057377 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8e37452a-05a9-4701-ab41-93615fc75264 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:11.060202 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8e37452a-05a9-4701-ab41-93615fc75264 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:11.061227 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8e37452a-05a9-4701-ab41-93615fc75264 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:11.062872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8e37452a-05a9-4701-ab41-93615fc75264 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:11.068542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0de525ac-b59a-4c23-b6db-b3461f95eea6 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.104321 Jun 22 09:13:11.069123 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 415/792] 10.222.0.55 () {58 vars in 1169 bytes} [Wed Jun 22 09:13:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:11.082609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-653e04e2-ee17-4462-a5ff-afe3bd0d4ba4 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e36f940>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:11.174863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-653e04e2-ee17-4462-a5ff-afe3bd0d4ba4 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.096102 Jun 22 09:13:11.175766 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 416/793] 10.222.0.55 () {58 vars in 1154 bytes} [Wed Jun 22 09:13:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:11.187222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4e4320dd-5360-4cdf-8058-638b9fcf46e4 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e313c10>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:11.273039 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4e4320dd-5360-4cdf-8058-638b9fcf46e4 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088012 Jun 22 09:13:11.273039 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 417/794] 10.222.0.55 () {58 vars in 1187 bytes} [Wed Jun 22 09:13:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:13:11.283829 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2aba19b8-de9d-4238-b2dd-dc9ce9eee0f5 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] Calling method '.version_select at 0x7f500e1fbd30>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:11.364017 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8e37452a-05a9-4701-ab41-93615fc75264 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:11.372046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8e37452a-05a9-4701-ab41-93615fc75264 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.328886 Jun 22 09:13:11.372605 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 378/795] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:11 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:11.379318 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5a39736f-9ccb-4fd2-959b-af6c7e1f3e94 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ccd232e-d837-4c53-93b8-fbe8f5e7527a"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:11.381760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5a39736f-9ccb-4fd2-959b-af6c7e1f3e94 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:11.381859 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2aba19b8-de9d-4238-b2dd-dc9ce9eee0f5 tempest-VolumesTestJSON-1279219509 tempest-VolumesTestJSON-1279219509-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.100914 Jun 22 09:13:11.388581 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5a39736f-9ccb-4fd2-959b-af6c7e1f3e94 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:11.389766 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5a39736f-9ccb-4fd2-959b-af6c7e1f3e94 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:11.390815 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5a39736f-9ccb-4fd2-959b-af6c7e1f3e94 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:11.391679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5a39736f-9ccb-4fd2-959b-af6c7e1f3e94 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:11.395536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 418/796] 10.222.0.55 () {58 vars in 1154 bytes} [Wed Jun 22 09:13:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:12.289033 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5a39736f-9ccb-4fd2-959b-af6c7e1f3e94 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.914235 Jun 22 09:13:12.289723 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 379/797] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:13:11 2022] POST /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:12.386534 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:12.391544 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1b034367-1fcc-4b3c-89f9-25f8bfce6546 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:12.392152 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1b034367-1fcc-4b3c-89f9-25f8bfce6546 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:12.398483 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b034367-1fcc-4b3c-89f9-25f8bfce6546 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:12.398960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b034367-1fcc-4b3c-89f9-25f8bfce6546 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:12.399716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b034367-1fcc-4b3c-89f9-25f8bfce6546 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:12.400151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b034367-1fcc-4b3c-89f9-25f8bfce6546 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:12.535679 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1b034367-1fcc-4b3c-89f9-25f8bfce6546 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:12.543383 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1b034367-1fcc-4b3c-89f9-25f8bfce6546 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.157646 Jun 22 09:13:12.544181 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 419/798] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:12 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:12.959751 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-323746905", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "feb2a623-753e-4717-8e5a-c83201989599"}], "security_groups": [{"name": "tempest-securitygroup--385522639"}], "key_name": "tempest-keypair-475260229", "user_data": "}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:13.069205 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] validate_networks() for [('feb2a623-753e-4717-8e5a-c83201989599', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:13:13.531315 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:13:13.533528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:13:13.533528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:13:13.533528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:13:13.533528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:13:13.542253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:13.542706 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:13.543665 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:13.544106 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:13.560997 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6c915b0c-3d83-464f-b266-a18807465d8b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:13.561609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6c915b0c-3d83-464f-b266-a18807465d8b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:13.562939 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:13:13.565268 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:13.567400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Getting quotas for user 0673a8903f56430f86f87b9447668300 and project dfcacaecd4564e90bfc76ff7e77911da. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:13:13.569343 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6c915b0c-3d83-464f-b266-a18807465d8b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:13.569794 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6c915b0c-3d83-464f-b266-a18807465d8b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:13.570562 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6c915b0c-3d83-464f-b266-a18807465d8b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:13.571069 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6c915b0c-3d83-464f-b266-a18807465d8b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:13.579876 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:13:13.582323 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:13:13.698089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ad1d107d-464c-4e54-9556-a03c65e9a1ce tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.745074 Jun 22 09:13:13.704037 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 380/799] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:13:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:13:13.709014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8f959964-1add-4010-9651-97a2e2ba8a5e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:13.709680 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8f959964-1add-4010-9651-97a2e2ba8a5e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:13.713222 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6c915b0c-3d83-464f-b266-a18807465d8b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:13.728735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6c915b0c-3d83-464f-b266-a18807465d8b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.167301 Jun 22 09:13:13.728735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 420/800] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:13 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:13.783001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8f959964-1add-4010-9651-97a2e2ba8a5e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:13.790624 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8f959964-1add-4010-9651-97a2e2ba8a5e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1240 microversion: 2.1 time: 0.085321 Jun 22 09:13:13.791352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 381/801] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:13 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:14.411341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ece56c29-892e-456b-a615-b89cbef50159 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:14.411918 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ece56c29-892e-456b-a615-b89cbef50159 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:14.417737 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ece56c29-892e-456b-a615-b89cbef50159 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:14.420647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ece56c29-892e-456b-a615-b89cbef50159 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:14.420647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ece56c29-892e-456b-a615-b89cbef50159 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:14.420647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ece56c29-892e-456b-a615-b89cbef50159 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:14.434791 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:14.547461 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ece56c29-892e-456b-a615-b89cbef50159 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:14.556474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ece56c29-892e-456b-a615-b89cbef50159 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1594 microversion: 2.1 time: 0.148686 Jun 22 09:13:14.557047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 421/802] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:14 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1594 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:14.743914 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c4604cf7-547e-496f-835e-b6708c7a2563 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:14.744550 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c4604cf7-547e-496f-835e-b6708c7a2563 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:14.751474 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c4604cf7-547e-496f-835e-b6708c7a2563 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:14.751832 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c4604cf7-547e-496f-835e-b6708c7a2563 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:14.752587 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c4604cf7-547e-496f-835e-b6708c7a2563 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:14.753017 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c4604cf7-547e-496f-835e-b6708c7a2563 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:14.756973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:14.808576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a030cd6d-d09c-4a6b-a084-17642dae4bf5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:14.809184 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a030cd6d-d09c-4a6b-a084-17642dae4bf5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:14.816396 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a030cd6d-d09c-4a6b-a084-17642dae4bf5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:14.816841 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a030cd6d-d09c-4a6b-a084-17642dae4bf5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:14.817603 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a030cd6d-d09c-4a6b-a084-17642dae4bf5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:14.818033 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a030cd6d-d09c-4a6b-a084-17642dae4bf5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:14.881766 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a030cd6d-d09c-4a6b-a084-17642dae4bf5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:14.890776 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a030cd6d-d09c-4a6b-a084-17642dae4bf5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1244 microversion: 2.1 time: 0.086735 Jun 22 09:13:14.891695 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 422/803] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:14 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:14.921095 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c4604cf7-547e-496f-835e-b6708c7a2563 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:14.928651 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c4604cf7-547e-496f-835e-b6708c7a2563 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.188519 Jun 22 09:13:14.929208 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 382/804] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:14 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:15.908309 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b58022b0-d160-4fc8-965c-4a64f68430cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:15.908868 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b58022b0-d160-4fc8-965c-4a64f68430cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:15.915684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b58022b0-d160-4fc8-965c-4a64f68430cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:15.916127 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b58022b0-d160-4fc8-965c-4a64f68430cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:15.916870 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b58022b0-d160-4fc8-965c-4a64f68430cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:15.917299 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b58022b0-d160-4fc8-965c-4a64f68430cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:15.945682 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-93d25176-97a4-402c-a74b-257795e3680e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:15.946555 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-93d25176-97a4-402c-a74b-257795e3680e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:15.955413 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-93d25176-97a4-402c-a74b-257795e3680e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:15.956023 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-93d25176-97a4-402c-a74b-257795e3680e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:15.956920 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-93d25176-97a4-402c-a74b-257795e3680e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:15.957585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-93d25176-97a4-402c-a74b-257795e3680e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:15.983440 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b58022b0-d160-4fc8-965c-4a64f68430cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:15.991138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b58022b0-d160-4fc8-965c-4a64f68430cd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1292 microversion: 2.1 time: 0.086661 Jun 22 09:13:15.999649 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 423/805] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:15 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:16.338301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-93d25176-97a4-402c-a74b-257795e3680e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:16.342613 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-93d25176-97a4-402c-a74b-257795e3680e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.400947 Jun 22 09:13:16.343211 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 383/806] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:15 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:17.008246 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7b05a09f-3f89-43e5-9659-a82b9f5bc79f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:17.009613 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7b05a09f-3f89-43e5-9659-a82b9f5bc79f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:17.019101 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b05a09f-3f89-43e5-9659-a82b9f5bc79f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:17.020213 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b05a09f-3f89-43e5-9659-a82b9f5bc79f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:17.021587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b05a09f-3f89-43e5-9659-a82b9f5bc79f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:17.022494 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7b05a09f-3f89-43e5-9659-a82b9f5bc79f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:17.148746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7b05a09f-3f89-43e5-9659-a82b9f5bc79f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:17.158114 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7b05a09f-3f89-43e5-9659-a82b9f5bc79f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1298 microversion: 2.1 time: 0.153661 Jun 22 09:13:17.158812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 424/807] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:17 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:17.364384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-873032d7-e557-4e3b-8846-8c6e65dc7f63 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:17.366939 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-873032d7-e557-4e3b-8846-8c6e65dc7f63 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:17.380147 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-873032d7-e557-4e3b-8846-8c6e65dc7f63 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:17.380147 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-873032d7-e557-4e3b-8846-8c6e65dc7f63 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:17.381996 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-873032d7-e557-4e3b-8846-8c6e65dc7f63 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:17.382791 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-873032d7-e557-4e3b-8846-8c6e65dc7f63 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:17.673191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-873032d7-e557-4e3b-8846-8c6e65dc7f63 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:17.681011 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-873032d7-e557-4e3b-8846-8c6e65dc7f63 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.324326 Jun 22 09:13:17.681693 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 384/808] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:17 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:17.807776 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-797a562e-e1b6-44b7-ab75-7b6000bd077f req-7d0df2c5-18ba-4731-ad13-1253f520f852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93eaaa7c-1a8d-404e-9194-0ef4556feee7", "tag": "687407a6-7cc6-4eaa-a14c-ef82cef3aa05"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:17.818200 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-797a562e-e1b6-44b7-ab75-7b6000bd077f req-7d0df2c5-18ba-4731-ad13-1253f520f852 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:17.819011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-797a562e-e1b6-44b7-ab75-7b6000bd077f req-7d0df2c5-18ba-4731-ad13-1253f520f852 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:17.834421 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-797a562e-e1b6-44b7-ab75-7b6000bd077f req-7d0df2c5-18ba-4731-ad13-1253f520f852 service nova] Creating event network-changed:687407a6-7cc6-4eaa-a14c-ef82cef3aa05 for instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 on hv-cinder-80382 Jun 22 09:13:17.840420 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-797a562e-e1b6-44b7-ab75-7b6000bd077f req-7d0df2c5-18ba-4731-ad13-1253f520f852 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036139 Jun 22 09:13:17.841432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 425/809] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:18.177054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7be8f991-783b-4770-8871-0f426aad2c9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:18.177054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7be8f991-783b-4770-8871-0f426aad2c9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:18.183168 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7be8f991-783b-4770-8871-0f426aad2c9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:18.183561 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7be8f991-783b-4770-8871-0f426aad2c9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:18.184415 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7be8f991-783b-4770-8871-0f426aad2c9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:18.184846 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7be8f991-783b-4770-8871-0f426aad2c9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:18.346122 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7be8f991-783b-4770-8871-0f426aad2c9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:18.358883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7be8f991-783b-4770-8871-0f426aad2c9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.182974 Jun 22 09:13:18.358883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 385/810] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:18 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:18.706810 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ae077d4b-c811-4201-84e3-9c49ba676b5c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:18.707566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ae077d4b-c811-4201-84e3-9c49ba676b5c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:18.719600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ae077d4b-c811-4201-84e3-9c49ba676b5c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:18.720086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ae077d4b-c811-4201-84e3-9c49ba676b5c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:18.734000 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ae077d4b-c811-4201-84e3-9c49ba676b5c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:18.734000 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ae077d4b-c811-4201-84e3-9c49ba676b5c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:18.941266 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ae077d4b-c811-4201-84e3-9c49ba676b5c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:18.952442 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ae077d4b-c811-4201-84e3-9c49ba676b5c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.255928 Jun 22 09:13:18.953369 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 426/811] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:18 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:19.372065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-60883adb-7822-41fd-921c-fd1be54fab90 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:19.372683 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-60883adb-7822-41fd-921c-fd1be54fab90 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:19.376703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:19.382364 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-60883adb-7822-41fd-921c-fd1be54fab90 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:19.384760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-60883adb-7822-41fd-921c-fd1be54fab90 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:19.388280 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-60883adb-7822-41fd-921c-fd1be54fab90 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:19.390075 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-60883adb-7822-41fd-921c-fd1be54fab90 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:19.630343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-60883adb-7822-41fd-921c-fd1be54fab90 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:19.640369 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-60883adb-7822-41fd-921c-fd1be54fab90 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.272155 Jun 22 09:13:19.652037 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 386/812] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:19 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:19.867036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-b256043f-0bcd-4dc6-bd9d-03165256bc9a req-249b15ed-a678-4a02-a21a-c95f1b265ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3da0ee91-0da9-40c6-b860-449aebadd656", "tag": "7ba767aa-b039-422a-8fb1-aaca65369474"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:19.879557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-b256043f-0bcd-4dc6-bd9d-03165256bc9a req-249b15ed-a678-4a02-a21a-c95f1b265ad7 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:19.880238 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-b256043f-0bcd-4dc6-bd9d-03165256bc9a req-249b15ed-a678-4a02-a21a-c95f1b265ad7 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:19.896336 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-b256043f-0bcd-4dc6-bd9d-03165256bc9a req-249b15ed-a678-4a02-a21a-c95f1b265ad7 service nova] Creating event network-changed:7ba767aa-b039-422a-8fb1-aaca65369474 for instance 3da0ee91-0da9-40c6-b860-449aebadd656 on hv-cinder-80382 Jun 22 09:13:19.906282 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-b256043f-0bcd-4dc6-bd9d-03165256bc9a req-249b15ed-a678-4a02-a21a-c95f1b265ad7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042886 Jun 22 09:13:19.907753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 427/813] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:19.970527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-44183c56-54ce-4057-91a3-20c088076708 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:19.972859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-44183c56-54ce-4057-91a3-20c088076708 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:19.980649 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-44183c56-54ce-4057-91a3-20c088076708 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:19.981099 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-44183c56-54ce-4057-91a3-20c088076708 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:19.981876 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-44183c56-54ce-4057-91a3-20c088076708 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:19.982340 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-44183c56-54ce-4057-91a3-20c088076708 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:20.143487 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-44183c56-54ce-4057-91a3-20c088076708 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:20.153679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-44183c56-54ce-4057-91a3-20c088076708 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.188031 Jun 22 09:13:20.154299 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 387/814] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:19 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:20.658131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c67ebc5d-6b54-4c15-86eb-ad1438da7c82 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:20.658845 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c67ebc5d-6b54-4c15-86eb-ad1438da7c82 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:20.665080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c67ebc5d-6b54-4c15-86eb-ad1438da7c82 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:20.665534 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c67ebc5d-6b54-4c15-86eb-ad1438da7c82 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:20.666303 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c67ebc5d-6b54-4c15-86eb-ad1438da7c82 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:20.666738 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c67ebc5d-6b54-4c15-86eb-ad1438da7c82 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.164487 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c67ebc5d-6b54-4c15-86eb-ad1438da7c82 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:21.172520 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2d73d2cc-82ab-423b-bdde-dab5667948b9 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:21.173824 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c67ebc5d-6b54-4c15-86eb-ad1438da7c82 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.519924 Jun 22 09:13:21.174326 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2d73d2cc-82ab-423b-bdde-dab5667948b9 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:21.181753 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d73d2cc-82ab-423b-bdde-dab5667948b9 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.182588 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d73d2cc-82ab-423b-bdde-dab5667948b9 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.183794 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 428/815] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:20 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:21.184639 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d73d2cc-82ab-423b-bdde-dab5667948b9 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.185862 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d73d2cc-82ab-423b-bdde-dab5667948b9 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.329672 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2d73d2cc-82ab-423b-bdde-dab5667948b9 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:21.337122 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2d73d2cc-82ab-423b-bdde-dab5667948b9 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1569 microversion: 2.1 time: 0.170517 Jun 22 09:13:21.337789 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 388/816] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:21 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:21.360983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-926c26c9-5e13-4875-b701-69b3cb991bef tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:21.360983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-926c26c9-5e13-4875-b701-69b3cb991bef tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:21.362547 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-926c26c9-5e13-4875-b701-69b3cb991bef tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.363038 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-926c26c9-5e13-4875-b701-69b3cb991bef tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.363830 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-926c26c9-5e13-4875-b701-69b3cb991bef tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.364782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-926c26c9-5e13-4875-b701-69b3cb991bef tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.497630 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6bd244ce-1bba-4318-977a-a7237da6fb4f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-406531291"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:21.499138 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6bd244ce-1bba-4318-977a-a7237da6fb4f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:21.508560 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6bd244ce-1bba-4318-977a-a7237da6fb4f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.509964 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6bd244ce-1bba-4318-977a-a7237da6fb4f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.510941 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6bd244ce-1bba-4318-977a-a7237da6fb4f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.518116 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6bd244ce-1bba-4318-977a-a7237da6fb4f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.744780 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.network.security_group_api [None req-6bd244ce-1bba-4318-977a-a7237da6fb4f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Adding security group b39900b2-aac7-4c44-85bf-8e90d0ac270c to port 687407a6-7cc6-4eaa-a14c-ef82cef3aa05 Jun 22 09:13:21.892512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-926c26c9-5e13-4875-b701-69b3cb991bef tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "POST /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f/action" status: 202 len: 0 microversion: 2.1 time: 0.542732 Jun 22 09:13:21.893608 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 429/817] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:13:21 2022] POST /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:13:21.930911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c17cd1cb-221d-45e9-a77c-9d7c7a4e5c42 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:21.931540 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c17cd1cb-221d-45e9-a77c-9d7c7a4e5c42 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:21.941831 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c17cd1cb-221d-45e9-a77c-9d7c7a4e5c42 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.942365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c17cd1cb-221d-45e9-a77c-9d7c7a4e5c42 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:21.943749 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c17cd1cb-221d-45e9-a77c-9d7c7a4e5c42 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:21.944267 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c17cd1cb-221d-45e9-a77c-9d7c7a4e5c42 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.137764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c17cd1cb-221d-45e9-a77c-9d7c7a4e5c42 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:22.146087 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c17cd1cb-221d-45e9-a77c-9d7c7a4e5c42 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1517 microversion: 2.1 time: 0.230895 Jun 22 09:13:22.146749 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 430/818] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:21 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:22.152666 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e80488e6-2fbb-4e20-b639-4d8c3264be44 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:22.154603 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e80488e6-2fbb-4e20-b639-4d8c3264be44 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:22.161930 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e80488e6-2fbb-4e20-b639-4d8c3264be44 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.162525 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e80488e6-2fbb-4e20-b639-4d8c3264be44 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.163439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e80488e6-2fbb-4e20-b639-4d8c3264be44 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.163939 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e80488e6-2fbb-4e20-b639-4d8c3264be44 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.212259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e80488e6-2fbb-4e20-b639-4d8c3264be44 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058963 Jun 22 09:13:22.212259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 431/819] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:22 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:22.212259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-dada7734-6111-46a5-a53d-cdadcbfcd13e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:22.213085 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-dada7734-6111-46a5-a53d-cdadcbfcd13e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:22.219725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dada7734-6111-46a5-a53d-cdadcbfcd13e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.220463 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dada7734-6111-46a5-a53d-cdadcbfcd13e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.221419 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dada7734-6111-46a5-a53d-cdadcbfcd13e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.222059 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dada7734-6111-46a5-a53d-cdadcbfcd13e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.237053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6bd244ce-1bba-4318-977a-a7237da6fb4f tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "POST /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/action" status: 202 len: 0 microversion: 2.1 time: 0.743402 Jun 22 09:13:22.238980 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 389/820] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:13:21 2022] POST /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:13:22.247748 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cd54b7b3-b565-4046-9abd-e81fdd5beef6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:22.249608 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cd54b7b3-b565-4046-9abd-e81fdd5beef6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:22.259693 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd54b7b3-b565-4046-9abd-e81fdd5beef6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.260538 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd54b7b3-b565-4046-9abd-e81fdd5beef6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.261681 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd54b7b3-b565-4046-9abd-e81fdd5beef6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.262673 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cd54b7b3-b565-4046-9abd-e81fdd5beef6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.391864 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cd54b7b3-b565-4046-9abd-e81fdd5beef6 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/4ccd232e-d837-4c53-93b8-fbe8f5e7527a" status: 200 len: 194 microversion: 2.1 time: 0.151321 Jun 22 09:13:22.392482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 390/821] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Jun 22 09:13:22 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/4ccd232e-d837-4c53-93b8-fbe8f5e7527a => generated 194 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:22.411446 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-2738f7f5-f0a0-4bb8-9475-3b78b6e8083d req-a2d3f16c-64f8-4e5a-a4f2-41f5ed24c604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93eaaa7c-1a8d-404e-9194-0ef4556feee7", "tag": "687407a6-7cc6-4eaa-a14c-ef82cef3aa05"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:22.425482 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-dada7734-6111-46a5-a53d-cdadcbfcd13e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:22.433138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-dada7734-6111-46a5-a53d-cdadcbfcd13e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.223967 Jun 22 09:13:22.433736 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 432/822] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:22 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:22.439963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c531bad8-2603-422d-b23d-3f624b829e93 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:22.441923 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c531bad8-2603-422d-b23d-3f624b829e93 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:22.449654 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-2738f7f5-f0a0-4bb8-9475-3b78b6e8083d req-a2d3f16c-64f8-4e5a-a4f2-41f5ed24c604 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.450237 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-2738f7f5-f0a0-4bb8-9475-3b78b6e8083d req-a2d3f16c-64f8-4e5a-a4f2-41f5ed24c604 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.464100 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c531bad8-2603-422d-b23d-3f624b829e93 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.465612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c531bad8-2603-422d-b23d-3f624b829e93 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.467929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c531bad8-2603-422d-b23d-3f624b829e93 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:22.468648 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c531bad8-2603-422d-b23d-3f624b829e93 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:22.480292 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-2738f7f5-f0a0-4bb8-9475-3b78b6e8083d req-a2d3f16c-64f8-4e5a-a4f2-41f5ed24c604 service nova] Creating event network-changed:687407a6-7cc6-4eaa-a14c-ef82cef3aa05 for instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 on hv-cinder-80382 Jun 22 09:13:22.490685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-2738f7f5-f0a0-4bb8-9475-3b78b6e8083d req-a2d3f16c-64f8-4e5a-a4f2-41f5ed24c604 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095661 Jun 22 09:13:22.491340 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 391/823] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:22.713067 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c531bad8-2603-422d-b23d-3f624b829e93 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:22.728163 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c531bad8-2603-422d-b23d-3f624b829e93 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1758 microversion: 2.1 time: 0.287787 Jun 22 09:13:22.728163 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 433/824] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:22 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1758 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:23.164662 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-036a7337-13a3-4498-960d-2a60b517855c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:23.165468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-036a7337-13a3-4498-960d-2a60b517855c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:23.177956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-036a7337-13a3-4498-960d-2a60b517855c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:23.177956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-036a7337-13a3-4498-960d-2a60b517855c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:23.177956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-036a7337-13a3-4498-960d-2a60b517855c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:23.177956 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-036a7337-13a3-4498-960d-2a60b517855c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:23.402643 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-2ebdf773-b80a-4b7e-b0e6-088b02461e3f req-5f5e6b9f-95b8-4363-8bc4-d2195c0d1547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8edf80c-1741-417f-ad42-4cdf4567898f", "name": "network-vif-unplugged", "status": "completed", "tag": "779d4f23-aa71-4166-aead-3f25b367efc9"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:23.420575 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-2ebdf773-b80a-4b7e-b0e6-088b02461e3f req-5f5e6b9f-95b8-4363-8bc4-d2195c0d1547 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:23.421021 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-2ebdf773-b80a-4b7e-b0e6-088b02461e3f req-5f5e6b9f-95b8-4363-8bc4-d2195c0d1547 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:23.450719 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.compute.server_external_events [req-2ebdf773-b80a-4b7e-b0e6-088b02461e3f req-5f5e6b9f-95b8-4363-8bc4-d2195c0d1547 service nova] Unable to find a host for instance a8edf80c-1741-417f-ad42-4cdf4567898f. Dropping event network-vif-unplugged {{(pid=118268) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 09:13:23.451911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-2ebdf773-b80a-4b7e-b0e6-088b02461e3f req-5f5e6b9f-95b8-4363-8bc4-d2195c0d1547 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055170 Jun 22 09:13:23.452497 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 434/825] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 09:13:23.460866 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3389c32a-9c2a-483b-a0ea-14d0db268a19 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:23.460866 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3389c32a-9c2a-483b-a0ea-14d0db268a19 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:23.464889 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3389c32a-9c2a-483b-a0ea-14d0db268a19 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:23.465342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3389c32a-9c2a-483b-a0ea-14d0db268a19 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:23.466107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3389c32a-9c2a-483b-a0ea-14d0db268a19 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:23.467134 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3389c32a-9c2a-483b-a0ea-14d0db268a19 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:23.552915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:23.629034 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-3389c32a-9c2a-483b-a0ea-14d0db268a19 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:23.636988 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3389c32a-9c2a-483b-a0ea-14d0db268a19 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.183177 Jun 22 09:13:23.637770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 435/826] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:23 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:23.650116 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-036a7337-13a3-4498-960d-2a60b517855c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:23.658176 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-036a7337-13a3-4498-960d-2a60b517855c tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1519 microversion: 2.1 time: 0.497670 Jun 22 09:13:23.658755 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 392/827] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:23 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1519 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:24.276153 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-25ff82e8-d024-46f4-bb40-d0dbc16ad2e9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18510a1a-fd88-4ccc-b66d-7140b0d94a29"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:24.277242 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-25ff82e8-d024-46f4-bb40-d0dbc16ad2e9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:24.284001 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-25ff82e8-d024-46f4-bb40-d0dbc16ad2e9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:24.284448 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-25ff82e8-d024-46f4-bb40-d0dbc16ad2e9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:24.286290 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-25ff82e8-d024-46f4-bb40-d0dbc16ad2e9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:24.286729 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-25ff82e8-d024-46f4-bb40-d0dbc16ad2e9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:24.653654 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8d5ea6d2-ea11-4d8f-8c9a-4d740c1db7f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:24.654284 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8d5ea6d2-ea11-4d8f-8c9a-4d740c1db7f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:24.656215 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=12 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:24.661593 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d5ea6d2-ea11-4d8f-8c9a-4d740c1db7f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:24.661981 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d5ea6d2-ea11-4d8f-8c9a-4d740c1db7f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:24.662724 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d5ea6d2-ea11-4d8f-8c9a-4d740c1db7f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:24.663180 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8d5ea6d2-ea11-4d8f-8c9a-4d740c1db7f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:24.798879 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8d5ea6d2-ea11-4d8f-8c9a-4d740c1db7f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:24.810903 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8d5ea6d2-ea11-4d8f-8c9a-4d740c1db7f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.158754 Jun 22 09:13:24.810903 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 393/828] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:24 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:24.815003 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c8ebc7ad-1cd3-4f7e-9a90-ef3dad9bf3f1 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:24.815838 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c8ebc7ad-1cd3-4f7e-9a90-ef3dad9bf3f1 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:24.821968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8ebc7ad-1cd3-4f7e-9a90-ef3dad9bf3f1 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:24.822488 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8ebc7ad-1cd3-4f7e-9a90-ef3dad9bf3f1 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:24.823378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8ebc7ad-1cd3-4f7e-9a90-ef3dad9bf3f1 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:24.823785 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c8ebc7ad-1cd3-4f7e-9a90-ef3dad9bf3f1 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:24.968790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c8ebc7ad-1cd3-4f7e-9a90-ef3dad9bf3f1 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:24.978109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c8ebc7ad-1cd3-4f7e-9a90-ef3dad9bf3f1 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1519 microversion: 2.1 time: 0.167248 Jun 22 09:13:24.978985 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 394/829] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:24 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:25.169362 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-25ff82e8-d024-46f4-bb40-d0dbc16ad2e9 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "POST /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.897019 Jun 22 09:13:25.170552 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 436/830] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:13:24 2022] POST /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:25.826399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-42776f2d-17b0-480e-96a3-f2937696f5ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:25.827036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-42776f2d-17b0-480e-96a3-f2937696f5ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:25.833353 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-42776f2d-17b0-480e-96a3-f2937696f5ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:25.833811 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-42776f2d-17b0-480e-96a3-f2937696f5ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:25.834871 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-42776f2d-17b0-480e-96a3-f2937696f5ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:25.835883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-42776f2d-17b0-480e-96a3-f2937696f5ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:25.997262 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-28c44be9-22fe-46f4-bc0a-4bb37b65e00d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:25.998095 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-28c44be9-22fe-46f4-bc0a-4bb37b65e00d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:26.006591 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-28c44be9-22fe-46f4-bc0a-4bb37b65e00d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:26.007166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-28c44be9-22fe-46f4-bc0a-4bb37b65e00d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:26.008016 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-28c44be9-22fe-46f4-bc0a-4bb37b65e00d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:26.008517 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-28c44be9-22fe-46f4-bc0a-4bb37b65e00d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:26.063267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-42776f2d-17b0-480e-96a3-f2937696f5ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:26.073429 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-42776f2d-17b0-480e-96a3-f2937696f5ef tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.251757 Jun 22 09:13:26.077187 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 395/831] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:25 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:26.185791 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-28c44be9-22fe-46f4-bc0a-4bb37b65e00d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:26.188144 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:26.194650 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-28c44be9-22fe-46f4-bc0a-4bb37b65e00d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.201801 Jun 22 09:13:26.195461 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 437/832] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:25 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:27.093521 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3f474c95-79f9-4f2a-bd44-b32645615c98 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:27.094036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3f474c95-79f9-4f2a-bd44-b32645615c98 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:27.100470 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3f474c95-79f9-4f2a-bd44-b32645615c98 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:27.100920 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3f474c95-79f9-4f2a-bd44-b32645615c98 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:27.101685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3f474c95-79f9-4f2a-bd44-b32645615c98 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:27.102123 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3f474c95-79f9-4f2a-bd44-b32645615c98 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:27.212854 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-dd8599bd-55b8-4c9f-b22c-d8b546e3510d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:27.214034 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-dd8599bd-55b8-4c9f-b22c-d8b546e3510d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:27.221763 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dd8599bd-55b8-4c9f-b22c-d8b546e3510d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:27.222408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dd8599bd-55b8-4c9f-b22c-d8b546e3510d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:27.223379 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dd8599bd-55b8-4c9f-b22c-d8b546e3510d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:27.223972 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-dd8599bd-55b8-4c9f-b22c-d8b546e3510d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:27.247558 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3f474c95-79f9-4f2a-bd44-b32645615c98 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:27.255488 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3f474c95-79f9-4f2a-bd44-b32645615c98 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.166288 Jun 22 09:13:27.256385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 396/833] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:27 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:27.378264 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-f4c62f75-cc85-4a04-8bd6-ed5b4f230ca4 req-039dd27d-dc83-4d40-952f-44cd0da5211e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3da0ee91-0da9-40c6-b860-449aebadd656", "name": "network-vif-plugged", "status": "completed", "tag": "7ba767aa-b039-422a-8fb1-aaca65369474"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:27.387572 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-f4c62f75-cc85-4a04-8bd6-ed5b4f230ca4 req-039dd27d-dc83-4d40-952f-44cd0da5211e service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:27.388128 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-f4c62f75-cc85-4a04-8bd6-ed5b4f230ca4 req-039dd27d-dc83-4d40-952f-44cd0da5211e service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:27.396848 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-dd8599bd-55b8-4c9f-b22c-d8b546e3510d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:27.404934 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-dd8599bd-55b8-4c9f-b22c-d8b546e3510d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.196238 Jun 22 09:13:27.412618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 438/834] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:27 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:27.412740 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-f4c62f75-cc85-4a04-8bd6-ed5b4f230ca4 req-039dd27d-dc83-4d40-952f-44cd0da5211e service nova] Creating event network-vif-plugged:7ba767aa-b039-422a-8fb1-aaca65369474 for instance 3da0ee91-0da9-40c6-b860-449aebadd656 on hv-cinder-80382 Jun 22 09:13:27.418003 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-f4c62f75-cc85-4a04-8bd6-ed5b4f230ca4 req-039dd27d-dc83-4d40-952f-44cd0da5211e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044222 Jun 22 09:13:27.418667 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 397/835] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:28.272320 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0c37053f-5ac6-4ca2-aa5f-61c7d7e272dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:28.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0c37053f-5ac6-4ca2-aa5f-61c7d7e272dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:28.279783 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0c37053f-5ac6-4ca2-aa5f-61c7d7e272dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:28.280226 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0c37053f-5ac6-4ca2-aa5f-61c7d7e272dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:28.280971 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0c37053f-5ac6-4ca2-aa5f-61c7d7e272dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:28.281400 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0c37053f-5ac6-4ca2-aa5f-61c7d7e272dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:28.417016 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0c37053f-5ac6-4ca2-aa5f-61c7d7e272dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:28.425033 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0c37053f-5ac6-4ca2-aa5f-61c7d7e272dc tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.156463 Jun 22 09:13:28.425836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 439/836] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:28 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:28.429652 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3093018e-72c0-46da-83c8-4de8ce27f9be tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:28.430360 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3093018e-72c0-46da-83c8-4de8ce27f9be tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:28.437311 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3093018e-72c0-46da-83c8-4de8ce27f9be tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:28.437951 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3093018e-72c0-46da-83c8-4de8ce27f9be tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:28.438714 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3093018e-72c0-46da-83c8-4de8ce27f9be tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:28.439301 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3093018e-72c0-46da-83c8-4de8ce27f9be tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:28.570939 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3093018e-72c0-46da-83c8-4de8ce27f9be tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:28.578411 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3093018e-72c0-46da-83c8-4de8ce27f9be tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.153354 Jun 22 09:13:28.579010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 398/837] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:28 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:29.441826 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c66e9204-20ab-4b77-9eab-cd5972fd4db8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:29.442438 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c66e9204-20ab-4b77-9eab-cd5972fd4db8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:29.448677 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c66e9204-20ab-4b77-9eab-cd5972fd4db8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:29.449133 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c66e9204-20ab-4b77-9eab-cd5972fd4db8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:29.449929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c66e9204-20ab-4b77-9eab-cd5972fd4db8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:29.450365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c66e9204-20ab-4b77-9eab-cd5972fd4db8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:29.591942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c66e9204-20ab-4b77-9eab-cd5972fd4db8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:29.595125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c5d0a3b2-20dd-49dc-82fa-d0dbfb858f26 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:29.595871 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c5d0a3b2-20dd-49dc-82fa-d0dbfb858f26 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:29.599927 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c66e9204-20ab-4b77-9eab-cd5972fd4db8 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1365 microversion: 2.1 time: 0.161825 Jun 22 09:13:29.600498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 440/838] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:29 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:29.602162 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5d0a3b2-20dd-49dc-82fa-d0dbfb858f26 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:29.602603 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5d0a3b2-20dd-49dc-82fa-d0dbfb858f26 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:29.603392 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5d0a3b2-20dd-49dc-82fa-d0dbfb858f26 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:29.604084 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c5d0a3b2-20dd-49dc-82fa-d0dbfb858f26 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:29.735092 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c5d0a3b2-20dd-49dc-82fa-d0dbfb858f26 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:29.742773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c5d0a3b2-20dd-49dc-82fa-d0dbfb858f26 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.151413 Jun 22 09:13:29.743376 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 399/839] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:29 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:30.617516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-38c6c333-d2fb-48ba-aa08-9828315e42d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:30.618054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-38c6c333-d2fb-48ba-aa08-9828315e42d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:30.625008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-38c6c333-d2fb-48ba-aa08-9828315e42d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:30.625449 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-38c6c333-d2fb-48ba-aa08-9828315e42d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:30.626192 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-38c6c333-d2fb-48ba-aa08-9828315e42d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:30.627054 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-38c6c333-d2fb-48ba-aa08-9828315e42d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:30.755111 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-38c6c333-d2fb-48ba-aa08-9828315e42d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:30.759551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3875cdd4-49ae-4397-8c90-a07fe2677e0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:30.760235 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3875cdd4-49ae-4397-8c90-a07fe2677e0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:30.762551 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-38c6c333-d2fb-48ba-aa08-9828315e42d2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1555 microversion: 2.1 time: 0.148967 Jun 22 09:13:30.763899 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 441/840] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:30 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:30.767395 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3875cdd4-49ae-4397-8c90-a07fe2677e0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:30.767837 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3875cdd4-49ae-4397-8c90-a07fe2677e0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:30.768586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3875cdd4-49ae-4397-8c90-a07fe2677e0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:30.769010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3875cdd4-49ae-4397-8c90-a07fe2677e0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:30.779238 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-794c4618-48d5-424e-828e-0645adbc4dbd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:30.779728 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-794c4618-48d5-424e-828e-0645adbc4dbd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:30.785550 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-794c4618-48d5-424e-828e-0645adbc4dbd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:30.785996 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-794c4618-48d5-424e-828e-0645adbc4dbd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:30.786548 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=100 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:30.786963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-794c4618-48d5-424e-828e-0645adbc4dbd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:30.787457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-794c4618-48d5-424e-828e-0645adbc4dbd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:30.864137 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-794c4618-48d5-424e-828e-0645adbc4dbd tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088454 Jun 22 09:13:30.865143 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 442/841] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 22 09:13:30 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:13:30.903854 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3875cdd4-49ae-4397-8c90-a07fe2677e0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:30.913114 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3875cdd4-49ae-4397-8c90-a07fe2677e0b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.157345 Jun 22 09:13:30.914050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 400/842] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:30 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:31.868478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-81cffde5-2427-4bf8-b6e2-94e8e2c56ef1 req-4d87389c-3211-472e-b9c0-aef3316e1c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3da0ee91-0da9-40c6-b860-449aebadd656", "tag": "7ba767aa-b039-422a-8fb1-aaca65369474"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:31.876935 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-81cffde5-2427-4bf8-b6e2-94e8e2c56ef1 req-4d87389c-3211-472e-b9c0-aef3316e1c2e service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:31.877373 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-81cffde5-2427-4bf8-b6e2-94e8e2c56ef1 req-4d87389c-3211-472e-b9c0-aef3316e1c2e service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:31.892415 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-81cffde5-2427-4bf8-b6e2-94e8e2c56ef1 req-4d87389c-3211-472e-b9c0-aef3316e1c2e service nova] Creating event network-changed:7ba767aa-b039-422a-8fb1-aaca65369474 for instance 3da0ee91-0da9-40c6-b860-449aebadd656 on hv-cinder-80382 Jun 22 09:13:31.898354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-81cffde5-2427-4bf8-b6e2-94e8e2c56ef1 req-4d87389c-3211-472e-b9c0-aef3316e1c2e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033906 Jun 22 09:13:31.899569 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 443/843] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:31.929384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0500d778-5199-4378-b4d2-8ddc6a711cbc tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:31.930112 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0500d778-5199-4378-b4d2-8ddc6a711cbc tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:31.940234 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0500d778-5199-4378-b4d2-8ddc6a711cbc tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:31.940896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0500d778-5199-4378-b4d2-8ddc6a711cbc tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:31.941724 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0500d778-5199-4378-b4d2-8ddc6a711cbc tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:31.942245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0500d778-5199-4378-b4d2-8ddc6a711cbc tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:32.080578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-0500d778-5199-4378-b4d2-8ddc6a711cbc tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:32.088551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0500d778-5199-4378-b4d2-8ddc6a711cbc tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.162921 Jun 22 09:13:32.094077 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 401/844] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:31 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:33.107475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9411cc94-64f4-4f1b-8dfc-c7a45b03a705 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:33.108770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9411cc94-64f4-4f1b-8dfc-c7a45b03a705 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:33.115066 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9411cc94-64f4-4f1b-8dfc-c7a45b03a705 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:33.115521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9411cc94-64f4-4f1b-8dfc-c7a45b03a705 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:33.116293 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9411cc94-64f4-4f1b-8dfc-c7a45b03a705 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:33.116792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9411cc94-64f4-4f1b-8dfc-c7a45b03a705 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:33.288882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9411cc94-64f4-4f1b-8dfc-c7a45b03a705 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:33.297157 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9411cc94-64f4-4f1b-8dfc-c7a45b03a705 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.194747 Jun 22 09:13:33.297842 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 444/845] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:33 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:34.313533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-37ce7056-1f11-4f7d-81f5-d346861dda13 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:34.314143 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-37ce7056-1f11-4f7d-81f5-d346861dda13 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:34.320837 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-37ce7056-1f11-4f7d-81f5-d346861dda13 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:34.321271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-37ce7056-1f11-4f7d-81f5-d346861dda13 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:34.322038 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-37ce7056-1f11-4f7d-81f5-d346861dda13 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:34.322516 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-37ce7056-1f11-4f7d-81f5-d346861dda13 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:34.453589 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-37ce7056-1f11-4f7d-81f5-d346861dda13 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:34.461112 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-37ce7056-1f11-4f7d-81f5-d346861dda13 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.151486 Jun 22 09:13:34.461680 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 402/846] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:34 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:34.794023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c2e421c2-0c77-4125-9f61-c596aa10725a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:34.795564 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c2e421c2-0c77-4125-9f61-c596aa10725a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:34.802153 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c2e421c2-0c77-4125-9f61-c596aa10725a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:34.802590 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c2e421c2-0c77-4125-9f61-c596aa10725a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:34.803423 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c2e421c2-0c77-4125-9f61-c596aa10725a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:34.803874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c2e421c2-0c77-4125-9f61-c596aa10725a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:34.834265 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c2e421c2-0c77-4125-9f61-c596aa10725a tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044196 Jun 22 09:13:34.836515 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 445/847] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:34 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:34.986399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e6818d1c-899c-409e-9338-953f93b6ad8c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:34.986963 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e6818d1c-899c-409e-9338-953f93b6ad8c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:34.992880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e6818d1c-899c-409e-9338-953f93b6ad8c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:34.993326 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e6818d1c-899c-409e-9338-953f93b6ad8c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:34.994078 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e6818d1c-899c-409e-9338-953f93b6ad8c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:34.994509 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e6818d1c-899c-409e-9338-953f93b6ad8c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:35.025051 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e6818d1c-899c-409e-9338-953f93b6ad8c tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/4ccd232e-d837-4c53-93b8-fbe8f5e7527a" status: 200 len: 194 microversion: 2.1 time: 0.042780 Jun 22 09:13:35.025653 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 403/848] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Jun 22 09:13:34 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/4ccd232e-d837-4c53-93b8-fbe8f5e7527a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:35.035806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-af32d2cd-2e4c-4b29-a2da-562d8acd47a7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:35.036299 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-af32d2cd-2e4c-4b29-a2da-562d8acd47a7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:35.042167 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-af32d2cd-2e4c-4b29-a2da-562d8acd47a7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:35.042691 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-af32d2cd-2e4c-4b29-a2da-562d8acd47a7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:35.043412 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-af32d2cd-2e4c-4b29-a2da-562d8acd47a7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:35.048679 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-af32d2cd-2e4c-4b29-a2da-562d8acd47a7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:35.123391 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-af32d2cd-2e4c-4b29-a2da-562d8acd47a7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lazy-loading 'services' on Instance uuid 4da52f0d-9679-4693-8b50-b3891b62b1c4 {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:13:35.326561 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-af32d2cd-2e4c-4b29-a2da-562d8acd47a7 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/4ccd232e-d837-4c53-93b8-fbe8f5e7527a" status: 202 len: 0 microversion: 2.1 time: 0.293939 Jun 22 09:13:35.327189 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 446/849] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:13:35 2022] DELETE /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/4ccd232e-d837-4c53-93b8-fbe8f5e7527a => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:13:35.477631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f74d9702-2349-467c-8bee-02c7e6a56dfa tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:35.478334 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f74d9702-2349-467c-8bee-02c7e6a56dfa tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:35.486576 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f74d9702-2349-467c-8bee-02c7e6a56dfa tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:35.487143 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f74d9702-2349-467c-8bee-02c7e6a56dfa tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:35.488036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f74d9702-2349-467c-8bee-02c7e6a56dfa tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:35.488578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f74d9702-2349-467c-8bee-02c7e6a56dfa tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:35.894597 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f74d9702-2349-467c-8bee-02c7e6a56dfa tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:35.902509 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f74d9702-2349-467c-8bee-02c7e6a56dfa tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.428806 Jun 22 09:13:35.903114 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 404/850] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:35 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:36.922491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-11e24154-4a8b-4c49-a76e-f406b8a0135d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:36.923214 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-11e24154-4a8b-4c49-a76e-f406b8a0135d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:36.929538 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-11e24154-4a8b-4c49-a76e-f406b8a0135d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:36.930028 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-11e24154-4a8b-4c49-a76e-f406b8a0135d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:36.930778 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-11e24154-4a8b-4c49-a76e-f406b8a0135d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:36.931230 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-11e24154-4a8b-4c49-a76e-f406b8a0135d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:37.071065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-11e24154-4a8b-4c49-a76e-f406b8a0135d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:37.079001 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-11e24154-4a8b-4c49-a76e-f406b8a0135d tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.162117 Jun 22 09:13:37.079558 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 447/851] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:36 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:37.335540 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-e48cf055-12cb-4848-b163-c7abc8da16db req-8456d97c-dab9-48a7-bc0e-2db2506a33d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8edf80c-1741-417f-ad42-4cdf4567898f", "name": "network-vif-plugged", "status": "completed", "tag": "779d4f23-aa71-4166-aead-3f25b367efc9"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:37.344767 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-e48cf055-12cb-4848-b163-c7abc8da16db req-8456d97c-dab9-48a7-bc0e-2db2506a33d4 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:37.345212 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-e48cf055-12cb-4848-b163-c7abc8da16db req-8456d97c-dab9-48a7-bc0e-2db2506a33d4 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:37.356871 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-e48cf055-12cb-4848-b163-c7abc8da16db req-8456d97c-dab9-48a7-bc0e-2db2506a33d4 service nova] Creating event network-vif-plugged:779d4f23-aa71-4166-aead-3f25b367efc9 for instance a8edf80c-1741-417f-ad42-4cdf4567898f on hv-cinder-80382 Jun 22 09:13:37.361920 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-e48cf055-12cb-4848-b163-c7abc8da16db req-8456d97c-dab9-48a7-bc0e-2db2506a33d4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030074 Jun 22 09:13:37.362581 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 405/852] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:37.501584 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-133da226-aeb5-4598-94f0-62baaf7b830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:37.502070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-133da226-aeb5-4598-94f0-62baaf7b830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:37.508707 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-133da226-aeb5-4598-94f0-62baaf7b830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:37.509151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-133da226-aeb5-4598-94f0-62baaf7b830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:37.510081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-133da226-aeb5-4598-94f0-62baaf7b830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:37.510517 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-133da226-aeb5-4598-94f0-62baaf7b830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:37.538770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-133da226-aeb5-4598-94f0-62baaf7b830b tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/18510a1a-fd88-4ccc-b66d-7140b0d94a29" status: 200 len: 194 microversion: 2.1 time: 0.041653 Jun 22 09:13:37.539384 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 448/853] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Jun 22 09:13:37 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/18510a1a-fd88-4ccc-b66d-7140b0d94a29 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:37.550472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0ff00a9b-1c5c-4fc7-a0df-270aed2e9bb3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:37.551157 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0ff00a9b-1c5c-4fc7-a0df-270aed2e9bb3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:37.557471 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0ff00a9b-1c5c-4fc7-a0df-270aed2e9bb3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:37.560510 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0ff00a9b-1c5c-4fc7-a0df-270aed2e9bb3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:37.560510 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0ff00a9b-1c5c-4fc7-a0df-270aed2e9bb3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:37.560510 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0ff00a9b-1c5c-4fc7-a0df-270aed2e9bb3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:37.641139 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-0ff00a9b-1c5c-4fc7-a0df-270aed2e9bb3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lazy-loading 'services' on Instance uuid 4da52f0d-9679-4693-8b50-b3891b62b1c4 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:13:37.849518 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0ff00a9b-1c5c-4fc7-a0df-270aed2e9bb3 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/18510a1a-fd88-4ccc-b66d-7140b0d94a29" status: 202 len: 0 microversion: 2.1 time: 0.302978 Jun 22 09:13:37.850031 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 406/854] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:13:37 2022] DELETE /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments/18510a1a-fd88-4ccc-b66d-7140b0d94a29 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:13:38.095993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-abfbaf85-0798-4d20-8c2d-6e5fdc7167eb tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:38.097463 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-abfbaf85-0798-4d20-8c2d-6e5fdc7167eb tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:38.104516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-abfbaf85-0798-4d20-8c2d-6e5fdc7167eb tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:38.104939 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-abfbaf85-0798-4d20-8c2d-6e5fdc7167eb tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:38.105700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-abfbaf85-0798-4d20-8c2d-6e5fdc7167eb tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:38.107214 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-abfbaf85-0798-4d20-8c2d-6e5fdc7167eb tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:38.240041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-abfbaf85-0798-4d20-8c2d-6e5fdc7167eb tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:38.247776 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-abfbaf85-0798-4d20-8c2d-6e5fdc7167eb tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.155714 Jun 22 09:13:38.248331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 449/855] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:38 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:39.265690 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-069f016c-4e55-4d70-9b5e-04ad013dd266 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:39.266384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-069f016c-4e55-4d70-9b5e-04ad013dd266 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:39.272801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-069f016c-4e55-4d70-9b5e-04ad013dd266 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:39.273243 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-069f016c-4e55-4d70-9b5e-04ad013dd266 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:39.274059 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-069f016c-4e55-4d70-9b5e-04ad013dd266 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:39.274513 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-069f016c-4e55-4d70-9b5e-04ad013dd266 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:39.408079 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-069f016c-4e55-4d70-9b5e-04ad013dd266 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:39.415613 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-069f016c-4e55-4d70-9b5e-04ad013dd266 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1575 microversion: 2.1 time: 0.154643 Jun 22 09:13:39.416186 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 407/856] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:39 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:40.432523 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-64f371a0-3038-4fb4-b88a-dc7a7e58f855 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:40.438169 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-64f371a0-3038-4fb4-b88a-dc7a7e58f855 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:40.441327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-64f371a0-3038-4fb4-b88a-dc7a7e58f855 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:40.442242 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-64f371a0-3038-4fb4-b88a-dc7a7e58f855 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:40.443093 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-64f371a0-3038-4fb4-b88a-dc7a7e58f855 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:40.443450 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-64f371a0-3038-4fb4-b88a-dc7a7e58f855 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:40.578892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-64f371a0-3038-4fb4-b88a-dc7a7e58f855 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:40.586579 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-64f371a0-3038-4fb4-b88a-dc7a7e58f855 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1562 microversion: 2.1 time: 0.157923 Jun 22 09:13:40.587205 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 450/857] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:40 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:41.113533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-34fe842f-e03a-42f1-ad4a-66269b7e9256 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:41.114504 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-34fe842f-e03a-42f1-ad4a-66269b7e9256 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:41.121037 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-34fe842f-e03a-42f1-ad4a-66269b7e9256 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.121476 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-34fe842f-e03a-42f1-ad4a-66269b7e9256 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:41.122772 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-34fe842f-e03a-42f1-ad4a-66269b7e9256 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.123276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-34fe842f-e03a-42f1-ad4a-66269b7e9256 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:41.152378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-34fe842f-e03a-42f1-ad4a-66269b7e9256 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042909 Jun 22 09:13:41.152938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 408/858] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:41 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:13:41.268181 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c010b1fe-7bf0-444c-ad19-b051e72a8d13 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:41.269074 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c010b1fe-7bf0-444c-ad19-b051e72a8d13 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:41.275158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c010b1fe-7bf0-444c-ad19-b051e72a8d13 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.275609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c010b1fe-7bf0-444c-ad19-b051e72a8d13 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:41.276484 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c010b1fe-7bf0-444c-ad19-b051e72a8d13 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.276918 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c010b1fe-7bf0-444c-ad19-b051e72a8d13 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:41.306260 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c010b1fe-7bf0-444c-ad19-b051e72a8d13 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041979 Jun 22 09:13:41.309353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 451/859] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:41 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:13:41.365184 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-011385c1-c4ce-4f92-afb7-ce1f1d49c82f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:41.365765 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-011385c1-c4ce-4f92-afb7-ce1f1d49c82f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:41.371676 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-011385c1-c4ce-4f92-afb7-ce1f1d49c82f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.372115 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-011385c1-c4ce-4f92-afb7-ce1f1d49c82f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:41.373376 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-011385c1-c4ce-4f92-afb7-ce1f1d49c82f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.373801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-011385c1-c4ce-4f92-afb7-ce1f1d49c82f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:41.398673 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-011385c1-c4ce-4f92-afb7-ce1f1d49c82f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:13:41.861919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-011385c1-c4ce-4f92-afb7-ce1f1d49c82f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 204 len: 0 microversion: 2.1 time: 0.500177 Jun 22 09:13:41.862529 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 409/860] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:13:41 2022] DELETE /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:13:41.870492 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9c407726-7bc7-4ac5-a892-94d30bd47ae1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:41.871107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9c407726-7bc7-4ac5-a892-94d30bd47ae1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:41.877966 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9c407726-7bc7-4ac5-a892-94d30bd47ae1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.879527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9c407726-7bc7-4ac5-a892-94d30bd47ae1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:41.879527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9c407726-7bc7-4ac5-a892-94d30bd47ae1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:41.879879 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9c407726-7bc7-4ac5-a892-94d30bd47ae1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:42.005759 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9c407726-7bc7-4ac5-a892-94d30bd47ae1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:42.013880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9c407726-7bc7-4ac5-a892-94d30bd47ae1 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1673 microversion: 2.1 time: 0.146579 Jun 22 09:13:42.014440 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 452/861] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:41 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:43.032117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-17fe1037-084e-481e-8ec2-58adbf772d7f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:43.032811 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-17fe1037-084e-481e-8ec2-58adbf772d7f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:43.039247 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-17fe1037-084e-481e-8ec2-58adbf772d7f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.041800 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-17fe1037-084e-481e-8ec2-58adbf772d7f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.041800 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-17fe1037-084e-481e-8ec2-58adbf772d7f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.041800 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-17fe1037-084e-481e-8ec2-58adbf772d7f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.171001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-17fe1037-084e-481e-8ec2-58adbf772d7f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:43.178408 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-17fe1037-084e-481e-8ec2-58adbf772d7f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1673 microversion: 2.1 time: 0.151189 Jun 22 09:13:43.179036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 410/862] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:43 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:43.584750 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-65c9b505-c715-4f69-9744-ddc5e985a98a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:43.585235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-65c9b505-c715-4f69-9744-ddc5e985a98a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:43.591699 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-65c9b505-c715-4f69-9744-ddc5e985a98a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.596784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-65c9b505-c715-4f69-9744-ddc5e985a98a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.596784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-65c9b505-c715-4f69-9744-ddc5e985a98a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.596784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-65c9b505-c715-4f69-9744-ddc5e985a98a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.616494 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-65c9b505-c715-4f69-9744-ddc5e985a98a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/ips" status: 200 len: 152 microversion: 2.20 time: 0.192238 Jun 22 09:13:43.616973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 453/863] 10.222.0.55 () {60 vars in 1288 bytes} [Wed Jun 22 09:13:43 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/ips => generated 152 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:13:44.197090 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a7fbbd37-e28c-4303-b6cc-90cf2225b57f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:44.199049 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a7fbbd37-e28c-4303-b6cc-90cf2225b57f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:44.206289 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3832952f-a1d2-4a2d-a31e-e9a4f44f6fdc tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:44.207353 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a7fbbd37-e28c-4303-b6cc-90cf2225b57f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:44.207498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3832952f-a1d2-4a2d-a31e-e9a4f44f6fdc tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:44.208159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a7fbbd37-e28c-4303-b6cc-90cf2225b57f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:44.209476 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=70 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:44.210175 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a7fbbd37-e28c-4303-b6cc-90cf2225b57f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:44.211390 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a7fbbd37-e28c-4303-b6cc-90cf2225b57f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:44.214716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3832952f-a1d2-4a2d-a31e-e9a4f44f6fdc tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:44.215730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3832952f-a1d2-4a2d-a31e-e9a4f44f6fdc tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:44.215975 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3832952f-a1d2-4a2d-a31e-e9a4f44f6fdc tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:44.219757 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3832952f-a1d2-4a2d-a31e-e9a4f44f6fdc tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:44.282962 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:44.452892 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a7fbbd37-e28c-4303-b6cc-90cf2225b57f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:44.462206 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3832952f-a1d2-4a2d-a31e-e9a4f44f6fdc tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "POST /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/action" status: 202 len: 0 microversion: 2.1 time: 0.260203 Jun 22 09:13:44.463758 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 454/864] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:13:44 2022] POST /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:13:44.468527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a7fbbd37-e28c-4303-b6cc-90cf2225b57f tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1673 microversion: 2.1 time: 0.272007 Jun 22 09:13:44.468527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 411/865] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:44 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1673 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:44.480941 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6220f42e-f84f-41bc-8ea4-62dbfac0632e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:44.482164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6220f42e-f84f-41bc-8ea4-62dbfac0632e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:44.491283 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6220f42e-f84f-41bc-8ea4-62dbfac0632e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:44.491736 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6220f42e-f84f-41bc-8ea4-62dbfac0632e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:44.492510 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6220f42e-f84f-41bc-8ea4-62dbfac0632e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:44.492946 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6220f42e-f84f-41bc-8ea4-62dbfac0632e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:44.681684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6220f42e-f84f-41bc-8ea4-62dbfac0632e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:44.691418 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6220f42e-f84f-41bc-8ea4-62dbfac0632e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1750 microversion: 2.1 time: 0.215298 Jun 22 09:13:44.692085 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 455/866] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:44 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1750 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:45.168626 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-35f29407-c34d-45d5-8acf-053f5d03d5c6 req-01bf85d9-9da0-4034-bb9c-f87ac3ef7162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da52f0d-9679-4693-8b50-b3891b62b1c4", "name": "network-vif-deleted", "tag": "0c0a5a8c-c11e-4b3a-bbae-bb0484acd5fe"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:45.177915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-35f29407-c34d-45d5-8acf-053f5d03d5c6 req-01bf85d9-9da0-4034-bb9c-f87ac3ef7162 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.182240 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-35f29407-c34d-45d5-8acf-053f5d03d5c6 req-01bf85d9-9da0-4034-bb9c-f87ac3ef7162 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.191624 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-35f29407-c34d-45d5-8acf-053f5d03d5c6 req-01bf85d9-9da0-4034-bb9c-f87ac3ef7162 service nova] Creating event network-vif-deleted:0c0a5a8c-c11e-4b3a-bbae-bb0484acd5fe for instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 on hv-cinder-80382 Jun 22 09:13:45.198384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-35f29407-c34d-45d5-8acf-053f5d03d5c6 req-01bf85d9-9da0-4034-bb9c-f87ac3ef7162 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033563 Jun 22 09:13:45.202019 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 412/867] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:45.482013 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f47c0c8c-f6c7-470d-8ee9-0b62c7d0cbf5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:45.482617 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f47c0c8c-f6c7-470d-8ee9-0b62c7d0cbf5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:45.489541 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f47c0c8c-f6c7-470d-8ee9-0b62c7d0cbf5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.490182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f47c0c8c-f6c7-470d-8ee9-0b62c7d0cbf5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.491006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f47c0c8c-f6c7-470d-8ee9-0b62c7d0cbf5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.491488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f47c0c8c-f6c7-470d-8ee9-0b62c7d0cbf5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.567885 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f47c0c8c-f6c7-470d-8ee9-0b62c7d0cbf5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abcbf501ca754212a16bbfbb901944f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b887d876b7624299b5575036da211d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:45.577121 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f47c0c8c-f6c7-470d-8ee9-0b62c7d0cbf5 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 200 len: 1322 microversion: 2.1 time: 0.099280 Jun 22 09:13:45.580596 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 456/868] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:45 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 1322 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:45.710019 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-0a9256e3-6598-4cd2-bf5d-daaeacd08ae6 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:45.710722 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-0a9256e3-6598-4cd2-bf5d-daaeacd08ae6 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:45.717041 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0a9256e3-6598-4cd2-bf5d-daaeacd08ae6 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.717492 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0a9256e3-6598-4cd2-bf5d-daaeacd08ae6 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.718252 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0a9256e3-6598-4cd2-bf5d-daaeacd08ae6 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.718691 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-0a9256e3-6598-4cd2-bf5d-daaeacd08ae6 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.829187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-56689123-72d9-409b-a590-7c79e7d2bf26 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:45.829764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-56689123-72d9-409b-a590-7c79e7d2bf26 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:45.835837 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56689123-72d9-409b-a590-7c79e7d2bf26 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.836354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56689123-72d9-409b-a590-7c79e7d2bf26 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.837075 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56689123-72d9-409b-a590-7c79e7d2bf26 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.837597 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-56689123-72d9-409b-a590-7c79e7d2bf26 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.863207 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-56689123-72d9-409b-a590-7c79e7d2bf26 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lazy-loading 'flavor' on Instance uuid e88cfdf9-1c62-4867-ae38-32484e4b2fdd {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:13:45.880775 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-0a9256e3-6598-4cd2-bf5d-daaeacd08ae6 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:45.889891 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-0a9256e3-6598-4cd2-bf5d-daaeacd08ae6 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.184503 Jun 22 09:13:45.894639 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 413/869] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:45 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:46.466609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-56689123-72d9-409b-a590-7c79e7d2bf26 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/action" status: 202 len: 0 microversion: 2.20 time: 0.641207 Jun 22 09:13:46.467414 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 457/870] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 22 09:13:45 2022] POST /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:13:46.475619 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:46.476221 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:46.483708 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.484374 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:46.485130 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.485559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:46.595556 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:46.596875 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:46.604253 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.604684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:46.605443 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.605868 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:46.620123 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] HTTP exception thrown: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Request method failure captured: Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 HTTP/1.1 Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvEdjAdBsNtlgfW4nJWT5bu-if7_eyOtFX6pzrgxAk3jD5_Cw0McBWwKKzdk6pUwFB0yuDQEPbjoLMfXy2nOdkhAMLUqKew2SFjvxv7hLSAn_kjYDMDxmGgl8lZDC6ejUw8qSrRrB4PXlEDWOjC2BCzY--I6VPXhD7XN3WAZQ6dY0Y Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:13:46.621836 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b887d876b7624299b5575036da211d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b887d876b7624299b5575036da211d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}] Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: abcbf501ca754212a16bbfbb901944f7 Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:46.623609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '4da52f0d-9679-4693-8b50-b3891b62b1c4'} Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:46.626061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:46.627721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:46.629318 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Returning 404 to user: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:46.629318 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-401250c1-b847-41b6-8f76-b64fb749490d tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 404 len: 111 microversion: 2.1 time: 0.033304 Jun 22 09:13:46.629318 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 458/871] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:46 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:13:46.632454 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:46.641686 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:46.643230 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:46.644144 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7b7e4ce9-6d20-4f57-a310-1373bb6f37eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '.version_select at 0x7f500e344700>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:46.644412 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-79a164d5-27ac-40d9-b76b-ba116845b8ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.172781 Jun 22 09:13:46.644959 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 414/872] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:46 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:46.868632 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7b7e4ce9-6d20-4f57-a310-1373bb6f37eb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106250707" status: 202 len: 0 microversion: 2.1 time: 0.228498 Jun 22 09:13:46.869215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 459/873] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 22 09:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106250707 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:13:46.908733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-53cd9c64-5d53-4c28-a075-e9f3533e2653 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:46.909896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-53cd9c64-5d53-4c28-a075-e9f3533e2653 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:46.916930 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-53cd9c64-5d53-4c28-a075-e9f3533e2653 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.921725 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-53cd9c64-5d53-4c28-a075-e9f3533e2653 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:46.921725 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-53cd9c64-5d53-4c28-a075-e9f3533e2653 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.921725 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-53cd9c64-5d53-4c28-a075-e9f3533e2653 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:47.061919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-53cd9c64-5d53-4c28-a075-e9f3533e2653 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:47.070541 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-53cd9c64-5d53-4c28-a075-e9f3533e2653 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.165341 Jun 22 09:13:47.070936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 415/874] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:46 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:47.667284 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:47.667822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:47.676389 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:47.676846 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:47.677622 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:47.678125 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:47.852901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:47.861996 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:47.863560 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:47.864779 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-534acc6e-ea3b-4655-a9ed-c9732c8caa90 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.202041 Jun 22 09:13:47.865331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 460/875] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:47 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:48.087701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-73b026ad-fccd-4e7a-a225-0bd7561a4c19 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:48.088317 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-73b026ad-fccd-4e7a-a225-0bd7561a4c19 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:48.095311 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73b026ad-fccd-4e7a-a225-0bd7561a4c19 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:48.095758 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73b026ad-fccd-4e7a-a225-0bd7561a4c19 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:48.096515 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73b026ad-fccd-4e7a-a225-0bd7561a4c19 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:48.096946 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-73b026ad-fccd-4e7a-a225-0bd7561a4c19 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:48.101063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:48.256177 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-73b026ad-fccd-4e7a-a225-0bd7561a4c19 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:48.264832 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-73b026ad-fccd-4e7a-a225-0bd7561a4c19 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.181007 Jun 22 09:13:48.265412 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 416/876] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:48 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:48.883128 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:48.883730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:48.891010 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:48.893215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:48.893215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:48.893215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:49.031961 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:49.040193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:49.041694 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:49.042911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-10ee9850-4211-4a3c-9a9e-cd07620bacdd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.163717 Jun 22 09:13:49.043466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 461/877] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:48 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:49.282800 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f9638995-27be-4f5f-9973-8045e10da0eb tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:49.283437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f9638995-27be-4f5f-9973-8045e10da0eb tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:49.289802 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f9638995-27be-4f5f-9973-8045e10da0eb tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:49.290247 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f9638995-27be-4f5f-9973-8045e10da0eb tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:49.291032 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f9638995-27be-4f5f-9973-8045e10da0eb tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:49.291467 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f9638995-27be-4f5f-9973-8045e10da0eb tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:49.448433 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f9638995-27be-4f5f-9973-8045e10da0eb tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:49.456319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f9638995-27be-4f5f-9973-8045e10da0eb tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.177378 Jun 22 09:13:49.461128 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 417/878] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:49 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:50.060870 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:50.061470 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:50.067942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.068385 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.069138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.069564 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.206479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:50.210226 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:50.210715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:50.212561 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:50.214541 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:50.216135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:50.217290 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bee456f7-6706-45c9-957f-1f82e06e1818 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.160332 Jun 22 09:13:50.217422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.217822 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.217948 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 462/879] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:50 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:50.218576 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.219033 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.233376 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] HTTP exception thrown: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Request method failure captured: Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 HTTP/1.1 Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvEdjAdBsNtlgfW4nJWT5bu-if7_eyOtFX6pzrgxAk3jD5_Cw0McBWwKKzdk6pUwFB0yuDQEPbjoLMfXy2nOdkhAMLUqKew2SFjvxv7hLSAn_kjYDMDxmGgl8lZDC6ejUw8qSrRrB4PXlEDWOjC2BCzY--I6VPXhD7XN3WAZQ6dY0Y Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:13:50.235063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b887d876b7624299b5575036da211d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b887d876b7624299b5575036da211d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}] Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: abcbf501ca754212a16bbfbb901944f7 Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.236666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '4da52f0d-9679-4693-8b50-b3891b62b1c4'} Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:50.237575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.239080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.240454 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Returning 404 to user: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:50.240454 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9a3a78cb-8bf7-429d-8e3c-20dd5275afca tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 404 len: 111 microversion: 2.1 time: 0.030219 Jun 22 09:13:50.240454 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 418/880] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:13:50 2022] DELETE /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:13:50.245016 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:50.245728 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 4da52f0d-9679-4693-8b50-b3891b62b1c4] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:50.252353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.252799 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.253634 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.254230 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.268968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] HTTP exception thrown: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Request method failure captured: Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 HTTP/1.1 Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvEdjAdBsNtlgfW4nJWT5bu-if7_eyOtFX6pzrgxAk3jD5_Cw0McBWwKKzdk6pUwFB0yuDQEPbjoLMfXy2nOdkhAMLUqKew2SFjvxv7hLSAn_kjYDMDxmGgl8lZDC6ejUw8qSrRrB4PXlEDWOjC2BCzY--I6VPXhD7XN3WAZQ6dY0Y Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:13:50.270573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b887d876b7624299b5575036da211d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b887d876b7624299b5575036da211d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}] Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: abcbf501ca754212a16bbfbb901944f7 Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.272146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '4da52f0d-9679-4693-8b50-b3891b62b1c4'} Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:50.273006 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. Jun 22 09:13:50.274456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.277650 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Returning 404 to user: Instance 4da52f0d-9679-4693-8b50-b3891b62b1c4 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:50.277650 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-781d1933-c560-41bd-b36d-648c87e26ea0 tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4" status: 404 len: 111 microversion: 2.1 time: 0.030833 Jun 22 09:13:50.277650 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 463/881] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:50 2022] GET /compute/v2.1/servers/4da52f0d-9679-4693-8b50-b3891b62b1c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:13:50.473913 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7366dc84-19b7-4c18-88cb-2cb2eb47436b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:50.474474 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7366dc84-19b7-4c18-88cb-2cb2eb47436b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:50.482263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7366dc84-19b7-4c18-88cb-2cb2eb47436b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.487350 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7366dc84-19b7-4c18-88cb-2cb2eb47436b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.487350 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7366dc84-19b7-4c18-88cb-2cb2eb47436b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.487350 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7366dc84-19b7-4c18-88cb-2cb2eb47436b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.635572 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7366dc84-19b7-4c18-88cb-2cb2eb47436b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:50.643679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7366dc84-19b7-4c18-88cb-2cb2eb47436b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.173663 Jun 22 09:13:50.644249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 419/882] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:50 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:51.237865 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:51.238483 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:51.244852 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.245293 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.246040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.246470 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.381626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:51.389851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:51.391407 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:51.392568 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9ba938b5-d210-4513-8a9b-430e031dfa02 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.158547 Jun 22 09:13:51.393123 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 464/883] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:51 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:51.578050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:51.578568 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:51.585158 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.585601 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.586354 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.586793 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.599736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] HTTP exception thrown: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Request method failure captured: Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa HTTP/1.1 Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvEdjAdBsNtlgfW4nJWT5bu-if7_eyOtFX6pzrgxAk3jD5_Cw0McBWwKKzdk6pUwFB0yuDQEPbjoLMfXy2nOdkhAMLUqKew2SFjvxv7hLSAn_kjYDMDxmGgl8lZDC6ejUw8qSrRrB4PXlEDWOjC2BCzY--I6VPXhD7XN3WAZQ6dY0Y Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:13:51.601342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b887d876b7624299b5575036da211d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b887d876b7624299b5575036da211d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}] Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: abcbf501ca754212a16bbfbb901944f7 Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.602938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '7a986f8d-3000-440e-b006-4c90b7c765fa'} Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:51.604117 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.605535 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.607638 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Returning 404 to user: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:51.607638 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e2a5c73c-4ccf-4c5b-af1a-48c5da9761bd tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 404 len: 111 microversion: 2.1 time: 0.028526 Jun 22 09:13:51.607638 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 420/884] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:13:51 2022] DELETE /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:13:51.611834 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:51.612451 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] [instance: 7a986f8d-3000-440e-b006-4c90b7c765fa] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:51.618365 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.620792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.620792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.620792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.633910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] HTTP exception thrown: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Request method failure captured: Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa HTTP/1.1 Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvEdjAdBsNtlgfW4nJWT5bu-if7_eyOtFX6pzrgxAk3jD5_Cw0McBWwKKzdk6pUwFB0yuDQEPbjoLMfXy2nOdkhAMLUqKew2SFjvxv7hLSAn_kjYDMDxmGgl8lZDC6ejUw8qSrRrB4PXlEDWOjC2BCzY--I6VPXhD7XN3WAZQ6dY0Y Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:13:51.635488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b887d876b7624299b5575036da211d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b887d876b7624299b5575036da211d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b887d876b7624299b5575036da211d6b"}]}] Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: b887d876b7624299b5575036da211d6b Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-937953402 Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: abcbf501ca754212a16bbfbb901944f7 Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeTestJSON-937953402-project Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.637646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '7a986f8d-3000-440e-b006-4c90b7c765fa'} Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:51.638940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. Jun 22 09:13:51.640700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:13:51.643008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] Returning 404 to user: Instance 7a986f8d-3000-440e-b006-4c90b7c765fa could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:51.643008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bee9d973-743e-4a40-b6dc-e03f77a5b1bb tempest-AttachVolumeTestJSON-937953402 tempest-AttachVolumeTestJSON-937953402-project] 10.222.0.55 "GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa" status: 404 len: 111 microversion: 2.1 time: 0.028912 Jun 22 09:13:51.643008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 465/885] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:51 2022] GET /compute/v2.1/servers/7a986f8d-3000-440e-b006-4c90b7c765fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:13:51.661047 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8dfae29e-1afa-459b-b99e-58a0720ba13b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:51.662192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8dfae29e-1afa-459b-b99e-58a0720ba13b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:51.668566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8dfae29e-1afa-459b-b99e-58a0720ba13b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.670272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8dfae29e-1afa-459b-b99e-58a0720ba13b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.670873 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8dfae29e-1afa-459b-b99e-58a0720ba13b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:51.671308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8dfae29e-1afa-459b-b99e-58a0720ba13b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:51.857577 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8dfae29e-1afa-459b-b99e-58a0720ba13b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:51.865566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8dfae29e-1afa-459b-b99e-58a0720ba13b tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.208736 Jun 22 09:13:51.866437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 421/886] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:51 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:52.425849 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:52.427044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:52.432867 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:52.433310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:52.434078 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:52.434503 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:52.646199 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:52.654604 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:52.656152 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:52.657315 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-064c1eac-4179-44d9-afc5-db44b1b65a2b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.250433 Jun 22 09:13:52.657871 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 466/887] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:52 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:52.883739 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6ab11029-8dbd-4ba9-9326-19bf7b258510 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:52.884351 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6ab11029-8dbd-4ba9-9326-19bf7b258510 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:52.891532 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6ab11029-8dbd-4ba9-9326-19bf7b258510 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:52.898885 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6ab11029-8dbd-4ba9-9326-19bf7b258510 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:52.898885 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6ab11029-8dbd-4ba9-9326-19bf7b258510 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:52.898885 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6ab11029-8dbd-4ba9-9326-19bf7b258510 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:53.042937 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-6ab11029-8dbd-4ba9-9326-19bf7b258510 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:53.051355 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6ab11029-8dbd-4ba9-9326-19bf7b258510 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.171446 Jun 22 09:13:53.061332 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 422/888] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:52 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:53.676107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:53.676935 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:53.683774 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:53.684285 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:53.685605 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:53.686037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:53.832373 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:53.841488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:53.843374 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:53.844894 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-698c2661-2389-45b5-b65c-c8a32eb415ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.172843 Jun 22 09:13:53.845547 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 467/889] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:53 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:54.071129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4a835b8e-c777-478e-b540-05bd6571ad46 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:54.071129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4a835b8e-c777-478e-b540-05bd6571ad46 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:54.076460 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4a835b8e-c777-478e-b540-05bd6571ad46 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.077172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4a835b8e-c777-478e-b540-05bd6571ad46 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.078434 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4a835b8e-c777-478e-b540-05bd6571ad46 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.079249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4a835b8e-c777-478e-b540-05bd6571ad46 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.243371 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4a835b8e-c777-478e-b540-05bd6571ad46 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:54.251974 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4a835b8e-c777-478e-b540-05bd6571ad46 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.187547 Jun 22 09:13:54.252630 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 423/890] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:54 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:54.864055 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:54.864665 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:54.871611 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.872564 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.873349 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.873949 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.056233 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:55.066599 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:55.069491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:55.070717 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4fcbcff6-07f7-4c1e-b6e3-71813e85969d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.211139 Jun 22 09:13:55.071509 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 468/891] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:54 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:55.270385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fd5ad04f-d8ca-48dc-aea5-00d40e57beba tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:55.271144 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-fd5ad04f-d8ca-48dc-aea5-00d40e57beba tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:55.279918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fd5ad04f-d8ca-48dc-aea5-00d40e57beba tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.280664 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fd5ad04f-d8ca-48dc-aea5-00d40e57beba tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.281639 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fd5ad04f-d8ca-48dc-aea5-00d40e57beba tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.282888 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-fd5ad04f-d8ca-48dc-aea5-00d40e57beba tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.577997 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-fd5ad04f-d8ca-48dc-aea5-00d40e57beba tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:55.588540 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fd5ad04f-d8ca-48dc-aea5-00d40e57beba tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.322697 Jun 22 09:13:55.589622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 424/892] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:55 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:56.088461 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:56.088999 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:56.096585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:56.097033 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:56.097915 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:56.098373 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:56.229890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:56.238323 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:56.239863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:56.241224 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-44ab6e2b-760f-4247-8d40-b7b3d6083f41 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.156830 Jun 22 09:13:56.241947 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 469/893] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:56 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:56.607200 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-10317f95-70ab-47c9-aa84-b07e6f816112 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:56.607742 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-10317f95-70ab-47c9-aa84-b07e6f816112 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:56.614453 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-10317f95-70ab-47c9-aa84-b07e6f816112 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:56.615197 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-10317f95-70ab-47c9-aa84-b07e6f816112 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:56.615685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-10317f95-70ab-47c9-aa84-b07e6f816112 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:56.616118 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-10317f95-70ab-47c9-aa84-b07e6f816112 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:56.915803 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-10317f95-70ab-47c9-aa84-b07e6f816112 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:56.925054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-10317f95-70ab-47c9-aa84-b07e6f816112 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1755 microversion: 2.1 time: 0.322579 Jun 22 09:13:56.925619 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 425/894] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:56 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1755 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:57.259820 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:57.260533 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:57.267610 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:57.268109 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:57.268819 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:57.269258 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:57.417404 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:57.427621 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:57.429398 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:57.430583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a496b1fe-ee2c-4002-b3ed-62af3fb664a7 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.174726 Jun 22 09:13:57.431169 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 470/895] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:57 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:57.942045 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4ba8e432-0aeb-4540-9daf-d7d8df91abc1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:57.942655 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4ba8e432-0aeb-4540-9daf-d7d8df91abc1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:57.949261 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4ba8e432-0aeb-4540-9daf-d7d8df91abc1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:57.949700 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4ba8e432-0aeb-4540-9daf-d7d8df91abc1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:57.951109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4ba8e432-0aeb-4540-9daf-d7d8df91abc1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:57.951533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4ba8e432-0aeb-4540-9daf-d7d8df91abc1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:58.101969 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4ba8e432-0aeb-4540-9daf-d7d8df91abc1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:58.111930 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4ba8e432-0aeb-4540-9daf-d7d8df91abc1 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1758 microversion: 2.1 time: 0.173285 Jun 22 09:13:58.112034 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 426/896] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:57 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:58.449410 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:58.450056 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:58.456839 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:58.457292 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:58.458062 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:58.458498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:58.591822 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:58.595304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:58.602515 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:58.604386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:58.605555 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1bcd2522-220d-463e-9ee5-a9c9ebb68e81 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.160217 Jun 22 09:13:58.606103 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 471/897] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:58 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:13:59.624932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:59.625474 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:59.632266 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:59.632740 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:59.633503 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:59.633935 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:59.776616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:59.784683 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:59.786339 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:59.787722 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9d7b95bc-18a1-49e8-8a4b-10ade544789f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.167297 Jun 22 09:13:59.788313 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 427/898] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:13:59 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:00.810199 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:00.810806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:00.817946 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:00.818387 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:00.819298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:00.819709 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:00.971070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:00.979223 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:00.986088 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:00.986088 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-70860778-821b-4247-a407-8d7867b6cf8f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.180632 Jun 22 09:14:00.986088 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 472/899] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:00 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:02.002037 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:02.003531 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:02.010706 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:02.011181 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:02.012010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:02.012949 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:02.150468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:02.158360 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:02.159961 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:02.161066 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3c055f2e-ee82-42ac-a092-9ce12a52ceee tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.163583 Jun 22 09:14:02.161957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 428/900] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:01 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:03.179207 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:03.179843 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:03.187047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:03.187492 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:03.188249 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:03.188708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:03.318468 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:03.326991 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:03.328552 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:03.329744 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-53ed3c66-4a61-4dcd-8713-1f35c71ba5fa tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1743 microversion: 2.20 time: 0.154862 Jun 22 09:14:03.330297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 473/901] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:03 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:04.348643 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:04.349259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:04.356135 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:04.356581 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:04.357343 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:04.357778 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:04.487050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:04.494976 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:04.496585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:04.498267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b263ce9e-e2e2-45e7-b1a0-5d169410b9ef tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1743 microversion: 2.20 time: 0.153083 Jun 22 09:14:04.498835 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 429/902] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:04 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:14:05.516972 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:05.517572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:05.523937 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:05.524380 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:05.525133 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:05.525718 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:05.667017 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:05.675100 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:05.676596 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:05.677743 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-502a2150-a86c-448d-93e6-0c28438c0e95 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1743 microversion: 2.20 time: 0.165400 Jun 22 09:14:05.678288 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 474/903] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:05 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:06.696371 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:06.696972 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:06.703479 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:06.703930 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:06.704707 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:06.705137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:06.838065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:06.846482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:06.848051 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:06.849203 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f7f83ff3-37e0-4de0-a862-eeaebb3fe0a8 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1743 microversion: 2.20 time: 0.156732 Jun 22 09:14:06.849746 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 430/904] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:06 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:07.867878 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:07.868669 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:07.876732 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:07.877181 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:07.877949 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:07.878591 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:08.072782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:08.082137 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:08.083740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:08.085352 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b0e1c83d-dd3e-4f5b-a758-bfb5b49603de tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.221827 Jun 22 09:14:08.094806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 475/905] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:07 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:08.456591 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-885a5ea7-6eba-4726-9828-0d6543df23e8 req-0ae99fb9-9b06-46ee-b84f-b8f2e70843cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88cfdf9-1c62-4867-ae38-32484e4b2fdd", "name": "network-vif-plugged", "status": "completed", "tag": "80ee4f92-8e74-49ff-9d1e-85edcc14992c"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:08.475222 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-885a5ea7-6eba-4726-9828-0d6543df23e8 req-0ae99fb9-9b06-46ee-b84f-b8f2e70843cf service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:08.475962 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-885a5ea7-6eba-4726-9828-0d6543df23e8 req-0ae99fb9-9b06-46ee-b84f-b8f2e70843cf service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:08.490909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-885a5ea7-6eba-4726-9828-0d6543df23e8 req-0ae99fb9-9b06-46ee-b84f-b8f2e70843cf service nova] Creating event network-vif-plugged:80ee4f92-8e74-49ff-9d1e-85edcc14992c for instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd on hv-cinder-80382 Jun 22 09:14:08.496334 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-885a5ea7-6eba-4726-9828-0d6543df23e8 req-0ae99fb9-9b06-46ee-b84f-b8f2e70843cf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043785 Jun 22 09:14:08.498158 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 431/906] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:09.117011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:09.118353 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:09.125560 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:09.126298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:09.127303 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:09.127958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:09.315191 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:09.324543 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:09.326931 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:09.329592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-109942d7-b09c-4b23-89aa-dda86b5561c1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.217307 Jun 22 09:14:09.330342 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 476/907] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:09 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:10.354447 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:10.355982 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:10.363672 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:10.364369 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:10.366010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:10.366446 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:10.506182 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:10.515068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:10.516895 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:10.518241 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bb14f2db-d539-4585-bf7a-dab7a55866b0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.169091 Jun 22 09:14:10.518799 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 432/908] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:10 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:11.537871 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:11.538554 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:11.545584 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:11.546040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:11.546855 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:11.547281 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:11.696408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:11.706131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:11.708029 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:11.709277 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6449c8cb-0ee8-4ae6-af54-76f91f369b93 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.176145 Jun 22 09:14:11.720452 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 477/909] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:11 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:12.730063 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:12.731367 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:12.738612 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:12.739319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:12.740092 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:12.740529 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:12.893530 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:12.902733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:12.906170 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:12.908131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-eb9e869b-857c-481b-bb93-c25777c6caa4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.183424 Jun 22 09:14:12.911936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 433/910] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:12 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:13.930295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:13.931161 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:13.938069 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:13.938516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:13.939295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:13.939773 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:14.072755 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:14.081451 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:14.082996 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:14.084197 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ec8026ee-6ea8-428e-80c2-72322f399d55 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.157920 Jun 22 09:14:14.084931 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 478/911] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:13 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:15.103053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:15.103716 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:15.111812 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:15.112542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:15.113294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:15.113733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:15.268661 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:15.273951 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=100 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:15.282367 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:15.284225 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:15.285589 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5d1be0f5-8e0a-4578-a300-5c2daba0a88a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.186651 Jun 22 09:14:15.293558 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 434/912] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:15 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:16.303459 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:16.305205 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:16.313195 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:16.315248 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:16.315899 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:16.317411 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:16.319626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:16.381309 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8f0025f9-8711-4319-bc2d-0af49be1b44a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:16.382665 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8f0025f9-8711-4319-bc2d-0af49be1b44a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:16.390966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8f0025f9-8711-4319-bc2d-0af49be1b44a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:16.392000 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8f0025f9-8711-4319-bc2d-0af49be1b44a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:16.393113 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8f0025f9-8711-4319-bc2d-0af49be1b44a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:16.393550 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8f0025f9-8711-4319-bc2d-0af49be1b44a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:16.419932 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8f0025f9-8711-4319-bc2d-0af49be1b44a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/ips" status: 200 len: 149 microversion: 2.1 time: 0.042673 Jun 22 09:14:16.420784 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 435/913] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:14:16 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:16.486801 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:16.498370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:16.500333 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:16.501754 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-951b2783-de71-4f9f-9980-7854d7dbebe0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.202583 Jun 22 09:14:16.502565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 479/914] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:16 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:17.520160 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:17.520773 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:17.527964 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:17.528414 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:17.529176 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:17.529607 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:17.672816 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:17.681132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:17.682715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:17.683907 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-585490a3-924b-4f18-afb7-3ed61422029a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.167702 Jun 22 09:14:17.684489 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 436/915] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:17 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:18.704576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:18.705178 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:18.711663 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:18.712100 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:18.712851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:18.713280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:18.851179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:18.859481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:18.860970 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:18.862113 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f3e9c9d8-0726-4bcc-87bc-60969b56c153 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.163560 Jun 22 09:14:18.862657 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 480/916] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:18 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:19.880206 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:19.880916 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:19.887307 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:19.887740 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:19.888489 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:19.888918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:20.019077 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:20.027091 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:20.028618 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:20.029767 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1352ae0f-1b94-4de7-a0b1-f075adec9391 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1738 microversion: 2.20 time: 0.153428 Jun 22 09:14:20.030328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 437/917] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:19 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:21.047911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:21.048520 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:21.054953 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:21.059940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:21.059940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:21.059940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:21.191533 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:21.200046 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:21.202255 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:21.203527 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f6f22367-b3e8-4b5c-b399-37fa72842e96 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1720 microversion: 2.20 time: 0.159632 Jun 22 09:14:21.204181 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 481/918] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:21 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:22.222247 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:22.222788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:22.225233 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=40 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:22.230161 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:22.230609 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:22.231391 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:22.231828 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:22.350740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fb5b57e7-84af-49c8-ac8a-bcfa9ffbfbe3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2b9bc5c-ab87-46f2-81b8-4f2066d7b583"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:22.351906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-fb5b57e7-84af-49c8-ac8a-bcfa9ffbfbe3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:22.358992 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fb5b57e7-84af-49c8-ac8a-bcfa9ffbfbe3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:22.359443 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fb5b57e7-84af-49c8-ac8a-bcfa9ffbfbe3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:22.363632 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:22.366603 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fb5b57e7-84af-49c8-ac8a-bcfa9ffbfbe3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:22.367147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fb5b57e7-84af-49c8-ac8a-bcfa9ffbfbe3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:22.372050 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:22.374130 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:22.375336 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-52dc13a3-c6ce-4167-87e6-6cfc8e4db289 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1720 microversion: 2.20 time: 0.157137 Jun 22 09:14:22.375905 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 438/919] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:22 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:23.393954 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:23.394584 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:23.400677 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:23.401129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:23.401884 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:23.402319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:23.540264 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:23.549102 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:23.551020 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:23.552175 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5e812c68-50d0-48f0-a509-2063f2fa4549 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1720 microversion: 2.20 time: 0.162002 Jun 22 09:14:23.552973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 439/920] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:23 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:14:24.419515 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fb5b57e7-84af-49c8-ac8a-bcfa9ffbfbe3 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "POST /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.072621 Jun 22 09:14:24.420146 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 482/921] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 22 09:14:22 2022] POST /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments => generated 194 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:14:24.430631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-199740f5-65d0-4351-bac2-ad1587776b5b req-980c8c5b-142d-46eb-bdd4-d63143e3720a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88cfdf9-1c62-4867-ae38-32484e4b2fdd", "name": "network-vif-unplugged", "status": "completed", "tag": "80ee4f92-8e74-49ff-9d1e-85edcc14992c"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:24.433754 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-199740f5-65d0-4351-bac2-ad1587776b5b req-980c8c5b-142d-46eb-bdd4-d63143e3720a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:24.434197 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-199740f5-65d0-4351-bac2-ad1587776b5b req-980c8c5b-142d-46eb-bdd4-d63143e3720a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:24.445004 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-199740f5-65d0-4351-bac2-ad1587776b5b req-980c8c5b-142d-46eb-bdd4-d63143e3720a service nova] Creating event network-vif-unplugged:80ee4f92-8e74-49ff-9d1e-85edcc14992c for instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd on hv-cinder-80382 Jun 22 09:14:24.450103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-199740f5-65d0-4351-bac2-ad1587776b5b req-980c8c5b-142d-46eb-bdd4-d63143e3720a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034906 Jun 22 09:14:24.450693 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 440/922] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:24.575817 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:24.577395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:24.584260 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:24.584706 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:24.585463 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:24.585893 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:24.749841 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:24.758287 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:24.760118 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:24.761538 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e6b38b73-b232-4091-b6b2-2c21c6ff9ca9 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1723 microversion: 2.20 time: 0.190057 Jun 22 09:14:24.762271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 483/923] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:24 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:24.780081 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-6ab1f89c-7064-491a-ac18-e824aa07bc48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39b9f9c7-9483-4293-9bcf-396b27a17c9b"}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:24.781214 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-6ab1f89c-7064-491a-ac18-e824aa07bc48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:24.787430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6ab1f89c-7064-491a-ac18-e824aa07bc48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:24.787881 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6ab1f89c-7064-491a-ac18-e824aa07bc48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:24.788617 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6ab1f89c-7064-491a-ac18-e824aa07bc48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:24.789044 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-6ab1f89c-7064-491a-ac18-e824aa07bc48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:26.122458 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-6ab1f89c-7064-491a-ac18-e824aa07bc48 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.346503 Jun 22 09:14:26.123633 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 441/924] 10.222.0.55 () {62 vars in 1363 bytes} [Wed Jun 22 09:14:24 2022] POST /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/os-volume_attachments => generated 188 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:14:26.238450 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0cd5eda4-3db2-4564-b7fd-e7ad6d0fcc7f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:26.238951 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0cd5eda4-3db2-4564-b7fd-e7ad6d0fcc7f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:26.245251 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0cd5eda4-3db2-4564-b7fd-e7ad6d0fcc7f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:26.247135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0cd5eda4-3db2-4564-b7fd-e7ad6d0fcc7f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:26.247135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0cd5eda4-3db2-4564-b7fd-e7ad6d0fcc7f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:26.247135 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0cd5eda4-3db2-4564-b7fd-e7ad6d0fcc7f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:28.807845 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:28.882283 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0cd5eda4-3db2-4564-b7fd-e7ad6d0fcc7f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/os-volume_attachments/39b9f9c7-9483-4293-9bcf-396b27a17c9b" status: 202 len: 0 microversion: 2.20 time: 2.647766 Jun 22 09:14:28.882905 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 484/925] 10.222.0.55 () {60 vars in 1456 bytes} [Wed Jun 22 09:14:26 2022] DELETE /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/os-volume_attachments/39b9f9c7-9483-4293-9bcf-396b27a17c9b => generated 0 bytes in 2649 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:14:28.939093 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c38628bc-65ca-49fb-a32a-20a056a44cf0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:28.939656 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c38628bc-65ca-49fb-a32a-20a056a44cf0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:28.946937 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c38628bc-65ca-49fb-a32a-20a056a44cf0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:28.947383 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c38628bc-65ca-49fb-a32a-20a056a44cf0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:28.948130 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c38628bc-65ca-49fb-a32a-20a056a44cf0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:28.948559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c38628bc-65ca-49fb-a32a-20a056a44cf0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:29.166111 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c38628bc-65ca-49fb-a32a-20a056a44cf0 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "POST /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/action" status: 202 len: 0 microversion: 2.20 time: 0.231523 Jun 22 09:14:29.166892 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 442/926] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 22 09:14:28 2022] POST /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:14:29.176328 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:29.176928 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:29.184572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:29.185019 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:29.185812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:29.186247 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:29.312809 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:29.321764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:29.323362 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:29.324519 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-27458e72-907f-4471-aa8f-52d501859d62 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1671 microversion: 2.20 time: 0.152513 Jun 22 09:14:29.325068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 485/927] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:29 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:14:30.342971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:30.343672 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:30.350232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:30.350743 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:30.351602 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:30.352028 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:30.485823 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:30.493837 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:30.495366 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:30.496514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7f1cf99b-3963-490f-9486-7a2604997573 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1671 microversion: 2.20 time: 0.157636 Jun 22 09:14:30.497072 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 443/928] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:30 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:14:31.515595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:31.516133 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:31.522700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:31.523175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:31.523920 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:31.524349 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:31.656649 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:31.664646 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:31.666166 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:31.667381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7cb43afa-ee20-4b86-98a9-8c7b681b267d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1673 microversion: 2.20 time: 0.156194 Jun 22 09:14:31.667952 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 486/929] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:31 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:32.685212 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:32.686439 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:32.693075 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:32.693550 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:32.694302 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:32.694733 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:32.823921 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:32.831780 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:32.833279 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:32.834427 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9258a822-179e-4d60-a14b-aa31f26f84c5 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.153218 Jun 22 09:14:32.835014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 444/930] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:32 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:33.852966 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:33.853570 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:33.860468 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:33.860914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:33.861883 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:33.862316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:33.994106 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:34.002658 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:34.004179 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:34.005316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cae8f608-ff19-4c8e-bafb-a1920b4cd199 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.156269 Jun 22 09:14:34.005873 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 487/931] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:33 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:35.023481 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:35.024062 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:35.030398 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:35.030856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:35.031607 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:35.032034 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:35.164700 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:35.173314 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:35.174802 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:35.175966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9fe68cf1-a390-4012-91dd-dd1faaeb5511 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.156416 Jun 22 09:14:35.176515 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 445/932] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:35 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:35.219114 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7036882d-fb8f-46dd-a0a2-8a466ed3c4e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:35.219630 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7036882d-fb8f-46dd-a0a2-8a466ed3c4e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:35.225944 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7036882d-fb8f-46dd-a0a2-8a466ed3c4e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:35.226398 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7036882d-fb8f-46dd-a0a2-8a466ed3c4e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:35.227176 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7036882d-fb8f-46dd-a0a2-8a466ed3c4e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:35.227608 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7036882d-fb8f-46dd-a0a2-8a466ed3c4e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:35.309685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-7036882d-fb8f-46dd-a0a2-8a466ed3c4e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'services' on Instance uuid 3da0ee91-0da9-40c6-b860-449aebadd656 {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:14:35.510228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7036882d-fb8f-46dd-a0a2-8a466ed3c4e2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments/c2b9bc5c-ab87-46f2-81b8-4f2066d7b583" status: 202 len: 0 microversion: 2.1 time: 0.295577 Jun 22 09:14:35.510865 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 488/933] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:14:35 2022] DELETE /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments/c2b9bc5c-ab87-46f2-81b8-4f2066d7b583 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:14:35.523606 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-24f80dde-27d7-44fa-8675-04769f234c32 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:35.524676 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-24f80dde-27d7-44fa-8675-04769f234c32 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:35.531459 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-24f80dde-27d7-44fa-8675-04769f234c32 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:35.531903 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-24f80dde-27d7-44fa-8675-04769f234c32 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:35.532651 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-24f80dde-27d7-44fa-8675-04769f234c32 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:35.533078 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-24f80dde-27d7-44fa-8675-04769f234c32 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:35.561281 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-24f80dde-27d7-44fa-8675-04769f234c32 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041733 Jun 22 09:14:35.561839 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 446/934] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:35 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:36.194688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:36.195414 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:36.202271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:36.202713 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:36.203488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:36.203920 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:36.337681 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:36.345560 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:36.347084 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:36.348295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-fc7924cc-8335-4b76-9c45-0604ea25490d tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.157904 Jun 22 09:14:36.348859 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 489/935] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:36 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:36.573156 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a214a652-24fb-41e6-999d-7a4bf288b96f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:36.574064 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a214a652-24fb-41e6-999d-7a4bf288b96f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:36.580747 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a214a652-24fb-41e6-999d-7a4bf288b96f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:36.581303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a214a652-24fb-41e6-999d-7a4bf288b96f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:36.582068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a214a652-24fb-41e6-999d-7a4bf288b96f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:36.582518 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a214a652-24fb-41e6-999d-7a4bf288b96f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:36.621220 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a214a652-24fb-41e6-999d-7a4bf288b96f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052233 Jun 22 09:14:36.621794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 447/936] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:36 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:37.366986 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:37.367683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:37.374616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:37.375094 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:37.375852 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:37.376322 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:37.601081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:37.610164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:37.611759 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:37.612859 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-12923ab8-1b40-412e-906d-0bc456e8b62c tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.249873 Jun 22 09:14:37.613416 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 490/937] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:37 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:37.632378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-04eb4935-d2fe-4926-a57e-ba1fddda99a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:37.633342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-04eb4935-d2fe-4926-a57e-ba1fddda99a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:37.640316 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-04eb4935-d2fe-4926-a57e-ba1fddda99a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:37.640774 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-04eb4935-d2fe-4926-a57e-ba1fddda99a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:37.641590 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-04eb4935-d2fe-4926-a57e-ba1fddda99a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:37.642027 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-04eb4935-d2fe-4926-a57e-ba1fddda99a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:37.667795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:37.672878 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-04eb4935-d2fe-4926-a57e-ba1fddda99a2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044457 Jun 22 09:14:37.673426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 448/938] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:37 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:38.631350 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:38.631962 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:38.638473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:38.639027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:38.639799 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:38.640238 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:38.684346 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-afd4aef2-b6ad-4207-ba87-ff6310eb7296 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:38.686049 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-afd4aef2-b6ad-4207-ba87-ff6310eb7296 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:38.693267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afd4aef2-b6ad-4207-ba87-ff6310eb7296 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:38.693715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afd4aef2-b6ad-4207-ba87-ff6310eb7296 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:38.694481 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afd4aef2-b6ad-4207-ba87-ff6310eb7296 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:38.694990 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-afd4aef2-b6ad-4207-ba87-ff6310eb7296 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:38.730693 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-afd4aef2-b6ad-4207-ba87-ff6310eb7296 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049882 Jun 22 09:14:38.731851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 449/939] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:38 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 09:14:38.796800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:38.802939 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2755a3cb-1e7e-4ab9-a872-a3a176eeb12e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:38.802939 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2755a3cb-1e7e-4ab9-a872-a3a176eeb12e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:38.808491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:38.810285 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:38.812926 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-81bbd24d-8ecc-49cf-a410-7e8851b631f1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.185493 Jun 22 09:14:38.813188 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2755a3cb-1e7e-4ab9-a872-a3a176eeb12e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:38.813694 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2755a3cb-1e7e-4ab9-a872-a3a176eeb12e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:38.814488 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2755a3cb-1e7e-4ab9-a872-a3a176eeb12e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:38.815021 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2755a3cb-1e7e-4ab9-a872-a3a176eeb12e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:38.826763 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 491/940] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:38 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:38.855002 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2755a3cb-1e7e-4ab9-a872-a3a176eeb12e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:14:39.331073 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2755a3cb-1e7e-4ab9-a872-a3a176eeb12e tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 204 len: 0 microversion: 2.1 time: 0.536986 Jun 22 09:14:39.331963 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 450/941] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:14:38 2022] DELETE /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:14:39.341548 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-90f680fe-0932-4c7d-88d5-9cf66a6ba912 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:39.342138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-90f680fe-0932-4c7d-88d5-9cf66a6ba912 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:39.353780 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-90f680fe-0932-4c7d-88d5-9cf66a6ba912 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:39.354896 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-90f680fe-0932-4c7d-88d5-9cf66a6ba912 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:39.355863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-90f680fe-0932-4c7d-88d5-9cf66a6ba912 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:39.356459 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-90f680fe-0932-4c7d-88d5-9cf66a6ba912 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:39.595206 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-90f680fe-0932-4c7d-88d5-9cf66a6ba912 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:39.605278 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-90f680fe-0932-4c7d-88d5-9cf66a6ba912 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.267895 Jun 22 09:14:39.605812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 492/942] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:39 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:14:39.834585 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:39.835341 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:39.842180 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:39.842624 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:39.843413 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:39.843898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:40.006784 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:40.015115 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:40.017323 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:40.017794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9c141b14-450a-42a7-b8de-29cb6c6571b1 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.187632 Jun 22 09:14:40.018337 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 451/943] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:39 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:14:40.624587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f7aabc7f-733d-4e5f-96ae-aff55aca75c6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:40.625943 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f7aabc7f-733d-4e5f-96ae-aff55aca75c6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:40.635119 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f7aabc7f-733d-4e5f-96ae-aff55aca75c6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:40.649386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f7aabc7f-733d-4e5f-96ae-aff55aca75c6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:40.649386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f7aabc7f-733d-4e5f-96ae-aff55aca75c6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:40.649386 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f7aabc7f-733d-4e5f-96ae-aff55aca75c6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:40.781300 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f7aabc7f-733d-4e5f-96ae-aff55aca75c6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:40.792121 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f7aabc7f-733d-4e5f-96ae-aff55aca75c6 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.172090 Jun 22 09:14:40.798751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 493/944] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:40 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:41.035974 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:41.036694 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:41.045429 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:41.045787 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:41.046568 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:41.047038 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:41.271162 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:41.279594 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:41.281188 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:41.282366 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-36b61205-37e1-4085-80e8-c06e7c7b6290 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.250401 Jun 22 09:14:41.282949 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 452/945] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:41 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:41.815611 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4f747388-091f-4ec2-992c-96bb56334b9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:41.817170 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4f747388-091f-4ec2-992c-96bb56334b9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:41.825540 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f747388-091f-4ec2-992c-96bb56334b9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:41.827020 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f747388-091f-4ec2-992c-96bb56334b9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:41.828011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f747388-091f-4ec2-992c-96bb56334b9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:41.828622 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f747388-091f-4ec2-992c-96bb56334b9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:42.057697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4f747388-091f-4ec2-992c-96bb56334b9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:42.065586 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4f747388-091f-4ec2-992c-96bb56334b9a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.255171 Jun 22 09:14:42.066686 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 494/946] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:41 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:42.301971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:42.303534 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:42.315794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:42.315794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:42.319516 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:42.320619 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:42.479144 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:42.487776 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:42.489262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:42.490393 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ecb0334c-81e5-4f4a-8a9c-0354887241dc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.192774 Jun 22 09:14:42.490971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 453/947] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:42 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:43.084364 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0a858aab-405d-4b72-83dc-24427d3d2cc0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:43.085058 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0a858aab-405d-4b72-83dc-24427d3d2cc0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:43.092094 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0a858aab-405d-4b72-83dc-24427d3d2cc0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:43.093361 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0a858aab-405d-4b72-83dc-24427d3d2cc0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:43.094030 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0a858aab-405d-4b72-83dc-24427d3d2cc0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:43.094710 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0a858aab-405d-4b72-83dc-24427d3d2cc0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:43.256954 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0a858aab-405d-4b72-83dc-24427d3d2cc0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:43.268540 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0a858aab-405d-4b72-83dc-24427d3d2cc0 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.187907 Jun 22 09:14:43.274840 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 495/948] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:43 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:43.509401 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:43.510101 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:43.517772 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:43.518672 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:43.519788 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:43.520486 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:43.704308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:43.714678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:43.716399 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:43.717714 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d6af3661-3c97-45fd-9096-eb1b8389b593 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.212578 Jun 22 09:14:43.724163 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 454/949] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:43 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:44.296807 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7df1a838-16fe-4042-a356-98a70d26559a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:44.297600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7df1a838-16fe-4042-a356-98a70d26559a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:44.304515 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7df1a838-16fe-4042-a356-98a70d26559a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:44.309628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7df1a838-16fe-4042-a356-98a70d26559a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:44.309628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7df1a838-16fe-4042-a356-98a70d26559a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:44.309628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7df1a838-16fe-4042-a356-98a70d26559a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:44.542453 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7df1a838-16fe-4042-a356-98a70d26559a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:44.550362 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7df1a838-16fe-4042-a356-98a70d26559a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.263232 Jun 22 09:14:44.551515 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 496/950] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:44 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:44.740231 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:44.741923 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:44.750987 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:44.751600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:44.752547 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:44.753076 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:44.913549 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:44.923270 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:44.925386 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:44.927516 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a243fec8-2b44-40a9-ae17-f7c59655d379 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.193790 Jun 22 09:14:44.928596 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 455/951] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:44 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:45.569041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b77efefb-77a9-4cbc-9d8c-88a0481e3a1d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:45.569768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b77efefb-77a9-4cbc-9d8c-88a0481e3a1d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:45.576491 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b77efefb-77a9-4cbc-9d8c-88a0481e3a1d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:45.576933 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b77efefb-77a9-4cbc-9d8c-88a0481e3a1d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:45.585138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b77efefb-77a9-4cbc-9d8c-88a0481e3a1d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:45.585590 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b77efefb-77a9-4cbc-9d8c-88a0481e3a1d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:45.757742 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b77efefb-77a9-4cbc-9d8c-88a0481e3a1d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:45.765980 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b77efefb-77a9-4cbc-9d8c-88a0481e3a1d tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.201312 Jun 22 09:14:45.766599 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 497/952] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:45 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:45.949464 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:45.950075 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:45.963311 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:45.963833 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:45.964644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:45.965086 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:46.121072 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:46.129648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:46.131206 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:46.132370 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a3cf5b8f-9419-4d95-b856-c7cbd6f697e4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.186950 Jun 22 09:14:46.132926 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 456/953] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:45 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:46.307603 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4c23bf7c-1a64-477c-84a3-4656b68f36b0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-406531291"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:46.308571 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4c23bf7c-1a64-477c-84a3-4656b68f36b0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:46.320583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c23bf7c-1a64-477c-84a3-4656b68f36b0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:46.322185 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c23bf7c-1a64-477c-84a3-4656b68f36b0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:46.322185 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c23bf7c-1a64-477c-84a3-4656b68f36b0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:46.322882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4c23bf7c-1a64-477c-84a3-4656b68f36b0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:46.479055 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.network.security_group_api [None req-4c23bf7c-1a64-477c-84a3-4656b68f36b0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Removing security group b39900b2-aac7-4c44-85bf-8e90d0ac270c from port 687407a6-7cc6-4eaa-a14c-ef82cef3aa05 Jun 22 09:14:46.788651 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-27385e3e-d0d9-457c-a3d5-e520376d3c7a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:46.789586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-27385e3e-d0d9-457c-a3d5-e520376d3c7a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:46.796115 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-27385e3e-d0d9-457c-a3d5-e520376d3c7a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:46.796854 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-27385e3e-d0d9-457c-a3d5-e520376d3c7a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:46.797818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-27385e3e-d0d9-457c-a3d5-e520376d3c7a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:46.798422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-27385e3e-d0d9-457c-a3d5-e520376d3c7a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:46.957091 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-27385e3e-d0d9-457c-a3d5-e520376d3c7a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:46.970574 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-27385e3e-d0d9-457c-a3d5-e520376d3c7a tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.190778 Jun 22 09:14:46.973501 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 457/954] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:46 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:47.015185 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4c23bf7c-1a64-477c-84a3-4656b68f36b0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "POST /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/action" status: 202 len: 0 microversion: 2.1 time: 0.711378 Jun 22 09:14:47.018800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 498/955] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 22 09:14:46 2022] POST /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:14:47.040509 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-1658595b-273c-42a6-9fbd-05623f6d06af req-2feaee7a-2523-495f-a192-d2b6eef3d710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93eaaa7c-1a8d-404e-9194-0ef4556feee7", "tag": "687407a6-7cc6-4eaa-a14c-ef82cef3aa05"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:47.067499 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-1658595b-273c-42a6-9fbd-05623f6d06af req-2feaee7a-2523-495f-a192-d2b6eef3d710 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:47.072797 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-1658595b-273c-42a6-9fbd-05623f6d06af req-2feaee7a-2523-495f-a192-d2b6eef3d710 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:47.109331 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-1658595b-273c-42a6-9fbd-05623f6d06af req-2feaee7a-2523-495f-a192-d2b6eef3d710 service nova] Creating event network-changed:687407a6-7cc6-4eaa-a14c-ef82cef3aa05 for instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 on hv-cinder-80382 Jun 22 09:14:47.114461 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-1658595b-273c-42a6-9fbd-05623f6d06af req-2feaee7a-2523-495f-a192-d2b6eef3d710 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085598 Jun 22 09:14:47.115723 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 458/956] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:47.149769 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:47.150157 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:47.164977 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:47.165439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:47.166622 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:47.166793 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:47.470548 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:47.482185 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:47.485119 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:47.486926 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e0efe99f-86c0-4471-b352-41d240daf274 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.341265 Jun 22 09:14:47.488186 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 499/957] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:47 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:47.991384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ace66074-e4ca-4833-8a87-c6acbf542dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:47.993032 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ace66074-e4ca-4833-8a87-c6acbf542dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:48.000145 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ace66074-e4ca-4833-8a87-c6acbf542dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:48.000593 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ace66074-e4ca-4833-8a87-c6acbf542dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:48.001464 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ace66074-e4ca-4833-8a87-c6acbf542dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:48.001899 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ace66074-e4ca-4833-8a87-c6acbf542dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:48.236481 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ace66074-e4ca-4833-8a87-c6acbf542dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:48.245445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ace66074-e4ca-4833-8a87-c6acbf542dad tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.258893 Jun 22 09:14:48.246019 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 459/958] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:47 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:48.506217 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:48.507774 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:48.517072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:48.517872 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:48.519027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:48.519711 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:48.754095 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:48.758272 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:48.767875 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:48.773547 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:48.779118 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ad2d8b04-fe6b-4b06-8889-15d01bcfc2a4 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.274692 Jun 22 09:14:48.779803 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 500/959] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:48 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:49.139794 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-69af1826-9776-4ca4-8150-a83332eda957 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:49.140345 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-69af1826-9776-4ca4-8150-a83332eda957 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:49.140968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-c9eb11e8-d868-4c15-93d5-781b45eb4d56 req-e016a71b-f5f3-4481-958c-4f3c1ad91497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93eaaa7c-1a8d-404e-9194-0ef4556feee7", "tag": "687407a6-7cc6-4eaa-a14c-ef82cef3aa05"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:49.145788 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=44 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:49.149079 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69af1826-9776-4ca4-8150-a83332eda957 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.149916 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69af1826-9776-4ca4-8150-a83332eda957 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.150927 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-c9eb11e8-d868-4c15-93d5-781b45eb4d56 req-e016a71b-f5f3-4481-958c-4f3c1ad91497 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.151192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69af1826-9776-4ca4-8150-a83332eda957 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.151736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-69af1826-9776-4ca4-8150-a83332eda957 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.151861 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-c9eb11e8-d868-4c15-93d5-781b45eb4d56 req-e016a71b-f5f3-4481-958c-4f3c1ad91497 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.164040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-c9eb11e8-d868-4c15-93d5-781b45eb4d56 req-e016a71b-f5f3-4481-958c-4f3c1ad91497 service nova] Creating event network-changed:687407a6-7cc6-4eaa-a14c-ef82cef3aa05 for instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 on hv-cinder-80382 Jun 22 09:14:49.169363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-c9eb11e8-d868-4c15-93d5-781b45eb4d56 req-e016a71b-f5f3-4481-958c-4f3c1ad91497 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032193 Jun 22 09:14:49.169963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 501/960] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:14:49.235241 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-69af1826-9776-4ca4-8150-a83332eda957 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lazy-loading 'services' on Instance uuid 93eaaa7c-1a8d-404e-9194-0ef4556feee7 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:14:49.263067 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-318226fc-82a1-4905-9933-829329a00498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:49.266469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-318226fc-82a1-4905-9933-829329a00498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:49.270049 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-318226fc-82a1-4905-9933-829329a00498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.270492 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-318226fc-82a1-4905-9933-829329a00498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.271284 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-318226fc-82a1-4905-9933-829329a00498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.271721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-318226fc-82a1-4905-9933-829329a00498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.439944 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-318226fc-82a1-4905-9933-829329a00498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:49.447531 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-318226fc-82a1-4905-9933-829329a00498 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.188852 Jun 22 09:14:49.448107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 502/961] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:49 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:14:49.461040 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-69af1826-9776-4ca4-8150-a83332eda957 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "DELETE /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments/76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7" status: 202 len: 0 microversion: 2.1 time: 0.326806 Jun 22 09:14:49.464545 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 460/962] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:14:49 2022] DELETE /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments/76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:14:49.471407 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0d368af4-bffe-4405-a42a-3cef34ad2295 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:49.472341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0d368af4-bffe-4405-a42a-3cef34ad2295 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:49.478198 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d368af4-bffe-4405-a42a-3cef34ad2295 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.478647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d368af4-bffe-4405-a42a-3cef34ad2295 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.479450 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d368af4-bffe-4405-a42a-3cef34ad2295 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.480148 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0d368af4-bffe-4405-a42a-3cef34ad2295 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.509526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0d368af4-bffe-4405-a42a-3cef34ad2295 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042027 Jun 22 09:14:49.510114 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 503/963] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:49 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:49.798127 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:49.799088 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:49.805911 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.807178 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.808097 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:49.808735 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:49.944513 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:49.953271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:49.954780 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:49.955992 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-36a1fa05-8ec7-4df8-bc19-01a28b0f379a tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.162188 Jun 22 09:14:49.956554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 461/964] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:49 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:50.464825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9d23339c-e17c-4798-be36-236cefae5dca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:50.465435 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9d23339c-e17c-4798-be36-236cefae5dca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:50.472307 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9d23339c-e17c-4798-be36-236cefae5dca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:50.472757 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9d23339c-e17c-4798-be36-236cefae5dca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:50.473507 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9d23339c-e17c-4798-be36-236cefae5dca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:50.473942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9d23339c-e17c-4798-be36-236cefae5dca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:50.522378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9986db77-2baf-400b-87b3-0c56538760e9 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:50.523381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9986db77-2baf-400b-87b3-0c56538760e9 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:50.529747 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9986db77-2baf-400b-87b3-0c56538760e9 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:50.530187 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9986db77-2baf-400b-87b3-0c56538760e9 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:50.530965 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9986db77-2baf-400b-87b3-0c56538760e9 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:50.531395 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9986db77-2baf-400b-87b3-0c56538760e9 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:50.560367 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9986db77-2baf-400b-87b3-0c56538760e9 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042015 Jun 22 09:14:50.560942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 462/965] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:50 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:50.604598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9d23339c-e17c-4798-be36-236cefae5dca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:50.612886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9d23339c-e17c-4798-be36-236cefae5dca tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.151972 Jun 22 09:14:50.613651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 504/966] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:50 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:50.975645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:50.976519 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:50.984245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:50.984918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:50.985980 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:50.986612 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:51.121809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:51.125319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:51.130044 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:51.131588 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:51.132741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d0e20ec2-035b-439c-9af9-0f429cbc9493 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.162342 Jun 22 09:14:51.133307 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 463/967] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:50 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:51.572557 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-91df9621-da89-46f8-8421-d1bbdfc80da3 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:51.573415 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-91df9621-da89-46f8-8421-d1bbdfc80da3 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:51.580050 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-91df9621-da89-46f8-8421-d1bbdfc80da3 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:51.580490 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-91df9621-da89-46f8-8421-d1bbdfc80da3 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:51.581238 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-91df9621-da89-46f8-8421-d1bbdfc80da3 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:51.581667 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-91df9621-da89-46f8-8421-d1bbdfc80da3 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:51.611080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-91df9621-da89-46f8-8421-d1bbdfc80da3 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Jun 22 09:14:51.611669 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 505/968] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:51 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:51.630305 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b2b11b83-e2d0-4082-b9b1-5094635bb998 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:51.630941 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b2b11b83-e2d0-4082-b9b1-5094635bb998 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:51.637710 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b2b11b83-e2d0-4082-b9b1-5094635bb998 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:51.638162 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b2b11b83-e2d0-4082-b9b1-5094635bb998 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:51.638951 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b2b11b83-e2d0-4082-b9b1-5094635bb998 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:51.639389 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b2b11b83-e2d0-4082-b9b1-5094635bb998 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:51.768819 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b2b11b83-e2d0-4082-b9b1-5094635bb998 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:51.776239 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b2b11b83-e2d0-4082-b9b1-5094635bb998 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.150122 Jun 22 09:14:51.776798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 464/969] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:51 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:52.150755 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:52.151382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:52.157400 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:52.157840 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:52.158585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:52.159048 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:52.289559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:52.297983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:52.299525 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:52.300676 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-321f8e6b-d231-425e-8386-dd3b0ab54e5e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.153896 Jun 22 09:14:52.301229 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 506/970] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:52 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:52.621666 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f18b1290-82c2-4d75-b34f-7bd19152ff6c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:52.622652 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f18b1290-82c2-4d75-b34f-7bd19152ff6c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:52.626005 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:52.630710 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f18b1290-82c2-4d75-b34f-7bd19152ff6c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:52.631316 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f18b1290-82c2-4d75-b34f-7bd19152ff6c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:52.631936 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f18b1290-82c2-4d75-b34f-7bd19152ff6c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:52.632365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f18b1290-82c2-4d75-b34f-7bd19152ff6c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:52.663995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f18b1290-82c2-4d75-b34f-7bd19152ff6c tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046247 Jun 22 09:14:52.664551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 465/971] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:52 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:52.793340 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d5255e09-9cfa-489c-a71d-50a01ba60e59 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:52.793861 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d5255e09-9cfa-489c-a71d-50a01ba60e59 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:52.800717 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d5255e09-9cfa-489c-a71d-50a01ba60e59 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:52.801160 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d5255e09-9cfa-489c-a71d-50a01ba60e59 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:52.801916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d5255e09-9cfa-489c-a71d-50a01ba60e59 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:52.802344 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d5255e09-9cfa-489c-a71d-50a01ba60e59 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:52.928331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d5255e09-9cfa-489c-a71d-50a01ba60e59 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:52.935711 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d5255e09-9cfa-489c-a71d-50a01ba60e59 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.146362 Jun 22 09:14:52.936274 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 507/972] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:52 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:53.319162 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:53.319772 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:53.326192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:53.326641 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:53.327518 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:53.328529 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:53.460926 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:53.468872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:53.470389 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:53.471619 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-35c1fc18-febd-4a3d-b939-dab74b588b1f tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.156731 Jun 22 09:14:53.472114 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 466/973] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:53 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:53.675918 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3730e9fd-eb05-4b79-a34f-8cdd31e90227 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:53.676880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3730e9fd-eb05-4b79-a34f-8cdd31e90227 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:53.682995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3730e9fd-eb05-4b79-a34f-8cdd31e90227 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:53.683443 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3730e9fd-eb05-4b79-a34f-8cdd31e90227 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:53.684202 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3730e9fd-eb05-4b79-a34f-8cdd31e90227 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:53.684641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3730e9fd-eb05-4b79-a34f-8cdd31e90227 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:53.714205 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3730e9fd-eb05-4b79-a34f-8cdd31e90227 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042763 Jun 22 09:14:53.714761 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 508/974] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:53 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:14:53.967988 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e067a00d-f725-4a75-8932-469aad476c48 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:53.967988 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e067a00d-f725-4a75-8932-469aad476c48 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:53.971840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e067a00d-f725-4a75-8932-469aad476c48 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:53.973919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e067a00d-f725-4a75-8932-469aad476c48 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:53.975086 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e067a00d-f725-4a75-8932-469aad476c48 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:53.975599 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e067a00d-f725-4a75-8932-469aad476c48 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:54.137536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e067a00d-f725-4a75-8932-469aad476c48 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:54.146328 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e067a00d-f725-4a75-8932-469aad476c48 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.196437 Jun 22 09:14:54.146924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 467/975] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:53 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:54.489761 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:54.490370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:54.496753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:54.497201 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:54.497957 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:54.498398 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:54.635193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:54.644333 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:54.648157 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:54.648157 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-93bcb8d3-47cc-46c7-9515-a680146aebfe tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.161177 Jun 22 09:14:54.648157 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 509/976] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:54 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:54.726684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-02d10e1a-f9e5-4928-9eb4-058466c76ca0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:54.728082 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-02d10e1a-f9e5-4928-9eb4-058466c76ca0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:54.735385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-02d10e1a-f9e5-4928-9eb4-058466c76ca0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:54.736270 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-02d10e1a-f9e5-4928-9eb4-058466c76ca0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:54.737207 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-02d10e1a-f9e5-4928-9eb4-058466c76ca0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:54.738123 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-02d10e1a-f9e5-4928-9eb4-058466c76ca0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:54.772785 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-02d10e1a-f9e5-4928-9eb4-058466c76ca0 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050252 Jun 22 09:14:54.773919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 468/977] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:54 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:55.165585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b68618e7-905d-4571-a7af-05901f48272f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:55.166694 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b68618e7-905d-4571-a7af-05901f48272f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:55.174641 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b68618e7-905d-4571-a7af-05901f48272f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:55.175273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b68618e7-905d-4571-a7af-05901f48272f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:55.175964 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b68618e7-905d-4571-a7af-05901f48272f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:55.176575 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b68618e7-905d-4571-a7af-05901f48272f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:55.533900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b68618e7-905d-4571-a7af-05901f48272f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:55.544524 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b68618e7-905d-4571-a7af-05901f48272f tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1679 microversion: 2.1 time: 0.383393 Jun 22 09:14:55.545132 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 510/978] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:55 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1679 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:55.668139 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:55.669876 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:55.681636 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:55.683968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:55.684950 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:55.686196 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:55.799541 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c9ee486a-f8ac-4b84-bf22-776da250d4d7 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:55.801118 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c9ee486a-f8ac-4b84-bf22-776da250d4d7 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:55.808956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c9ee486a-f8ac-4b84-bf22-776da250d4d7 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:55.809741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c9ee486a-f8ac-4b84-bf22-776da250d4d7 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:55.810745 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c9ee486a-f8ac-4b84-bf22-776da250d4d7 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:55.813938 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c9ee486a-f8ac-4b84-bf22-776da250d4d7 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:55.890595 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c9ee486a-f8ac-4b84-bf22-776da250d4d7 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108863 Jun 22 09:14:55.893631 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 511/979] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 22 09:14:55 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:14:55.901839 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-b7a2b529-e92f-46e0-a039-2cca4e6543c1 req-5c426b9b-5429-43e0-bd53-c06986672660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3da0ee91-0da9-40c6-b860-449aebadd656", "name": "network-vif-deleted", "tag": "7ba767aa-b039-422a-8fb1-aaca65369474"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:55.926654 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-b7a2b529-e92f-46e0-a039-2cca4e6543c1 req-5c426b9b-5429-43e0-bd53-c06986672660 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:55.927698 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-b7a2b529-e92f-46e0-a039-2cca4e6543c1 req-5c426b9b-5429-43e0-bd53-c06986672660 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:55.960235 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-b7a2b529-e92f-46e0-a039-2cca4e6543c1 req-5c426b9b-5429-43e0-bd53-c06986672660 service nova] Creating event network-vif-deleted:7ba767aa-b039-422a-8fb1-aaca65369474 for instance 3da0ee91-0da9-40c6-b860-449aebadd656 on hv-cinder-80382 Jun 22 09:14:55.973441 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-b7a2b529-e92f-46e0-a039-2cca4e6543c1 req-5c426b9b-5429-43e0-bd53-c06986672660 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075717 Jun 22 09:14:55.974456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 512/980] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:55.981185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:55.986305 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:55.986927 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:55.994391 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:56.003435 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:56.004211 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:56.004666 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:56.006059 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9d199fba-8fcf-4d5a-b1e0-1cf6bb3e1910 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.344934 Jun 22 09:14:56.009853 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 469/981] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:55 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:14:56.016651 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:56.017390 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:56.163790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] HTTP exception thrown: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 is not attached to volume 76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7 Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Request method failure captured: Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: DELETE /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments/76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7 HTTP/1.1 Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistzrE02PtXN9Neb4_CsTpef5PFKYhMdrPhFdka3jUNxA7KqjIXLiTVP7m4NYYpY8xp0grE2upaSZBJTaZNgfm3h9P6ZMD4B-DCg-vWUkg2bGb280vYYh5k-JQ_wxDJzKKzty7HWHR6r8_z7VJkzsSODwh15Kgnn-cQE8mhSRztZdkMM Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 476725d6c5c44caebdd8d8e855cc63c6 Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-TestMinimumBasicScenario-125622905 Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:14:56.169994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/476725d6c5c44caebdd8d8e855cc63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_476725d6c5c44caebdd8d8e855cc63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/476725d6c5c44caebdd8d8e855cc63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/476725d6c5c44caebdd8d8e855cc63c6"}]}] Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-TestMinimumBasicScenario-125622905 Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 476725d6c5c44caebdd8d8e855cc63c6 Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-TestMinimumBasicScenario-125622905 Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-TestMinimumBasicScenario-125622905-project Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 4d6a812133cf437fa3e13f56d1cddd53 Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-TestMinimumBasicScenario-125622905-project Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:14:56.171764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 is not attached to volume 76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7 Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'server_id': '93eaaa7c-1a8d-404e-9194-0ef4556feee7', 'id': '76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7'} Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7. Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:14:56.172578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 is not attached to volume 76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7 Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 is not attached to volume 76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7 Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:14:56.174076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Returning 404 to user: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 is not attached to volume 76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7 {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:14:56.175287 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-109386e5-4d63-4516-be7f-4f058dc8c589 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "DELETE /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments/76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7" status: 404 len: 154 microversion: 2.1 time: 0.193412 Jun 22 09:14:56.175516 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 513/982] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 22 09:14:55 2022] DELETE /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7/os-volume_attachments/76f0cdc0-b6ab-4914-9fbb-7fc0f5a4f8c7 => generated 154 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:14:56.563988 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:56.564661 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:56.578047 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:56.578483 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:56.579559 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:56.579991 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:56.613153 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:56.613599 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:56.614053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lazy-loading 'fault' on Instance uuid 3da0ee91-0da9-40c6-b860-449aebadd656 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:14:56.655176 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0673a8903f56430f86f87b9447668300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcacaecd4564e90bfc76ff7e77911da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:56.662741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1df3b758-4357-4c8a-821a-5d8f19bfcba4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 200 len: 1330 microversion: 2.1 time: 0.103828 Jun 22 09:14:56.663263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 470/983] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:56 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:14:56.900608 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-a44404a0-b397-473d-8b4c-5cd3c55ea697 req-5d674a27-0ba9-4a22-b439-616b3afc7b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88cfdf9-1c62-4867-ae38-32484e4b2fdd", "name": "network-vif-plugged", "status": "completed", "tag": "80ee4f92-8e74-49ff-9d1e-85edcc14992c"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:56.912047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-a44404a0-b397-473d-8b4c-5cd3c55ea697 req-5d674a27-0ba9-4a22-b439-616b3afc7b7d service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:56.912808 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-a44404a0-b397-473d-8b4c-5cd3c55ea697 req-5d674a27-0ba9-4a22-b439-616b3afc7b7d service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:56.925093 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-a44404a0-b397-473d-8b4c-5cd3c55ea697 req-5d674a27-0ba9-4a22-b439-616b3afc7b7d service nova] Creating event network-vif-plugged:80ee4f92-8e74-49ff-9d1e-85edcc14992c for instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd on hv-cinder-80382 Jun 22 09:14:56.930264 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-a44404a0-b397-473d-8b4c-5cd3c55ea697 req-5d674a27-0ba9-4a22-b439-616b3afc7b7d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034683 Jun 22 09:14:56.930897 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 514/984] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:57.027678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:57.028742 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:57.037781 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.038227 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:57.039018 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.039450 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:57.195290 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:57.202158 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:57.204216 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:57.205425 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-df5b4cef-94c4-4f29-8d24-d38cb937a196 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.181665 Jun 22 09:14:57.206285 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 471/985] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:57 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:57.609735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f38ecbe0-8bee-4a01-9a0c-a00cb32cea07 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:57.610366 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f38ecbe0-8bee-4a01-9a0c-a00cb32cea07 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:57.618232 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f38ecbe0-8bee-4a01-9a0c-a00cb32cea07 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.618850 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f38ecbe0-8bee-4a01-9a0c-a00cb32cea07 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:57.619626 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f38ecbe0-8bee-4a01-9a0c-a00cb32cea07 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.620086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f38ecbe0-8bee-4a01-9a0c-a00cb32cea07 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:57.647640 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f38ecbe0-8bee-4a01-9a0c-a00cb32cea07 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Going to try to terminate instance {{(pid=118268) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:14:57.683150 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:57.683420 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:57.692156 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.692621 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:57.693775 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.694212 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:57.712684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 HTTP/1.1 Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:14:57.717007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:14:57.723232 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '3da0ee91-0da9-40c6-b860-449aebadd656'} Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:14:57.724365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:14:57.725898 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:14:57.727272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:14:57.727272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5090466a-bd27-4ee3-ab9c-fa48e1606c34 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 404 len: 111 microversion: 2.1 time: 0.038136 Jun 22 09:14:57.727272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 472/986] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:57 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:14:57.731781 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-309d7c6d-82b1-426d-b0a3-c439715530f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '.version_select at 0x7f500e53fc10>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:57.857359 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-309d7c6d-82b1-426d-b0a3-c439715530f5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475260229" status: 202 len: 0 microversion: 2.1 time: 0.133177 Jun 22 09:14:57.857935 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 473/987] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 22 09:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475260229 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:14:57.975987 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f38ecbe0-8bee-4a01-9a0c-a00cb32cea07 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "DELETE /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 204 len: 0 microversion: 2.1 time: 0.371065 Jun 22 09:14:57.976701 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 515/988] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:14:57 2022] DELETE /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:14:57.985611 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d48f7a8d-e8a0-4548-a51a-4106620bbd15 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:57.986698 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d48f7a8d-e8a0-4548-a51a-4106620bbd15 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:57.993547 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d48f7a8d-e8a0-4548-a51a-4106620bbd15 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.993991 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d48f7a8d-e8a0-4548-a51a-4106620bbd15 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:57.994742 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d48f7a8d-e8a0-4548-a51a-4106620bbd15 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:57.995226 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d48f7a8d-e8a0-4548-a51a-4106620bbd15 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:58.183236 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d48f7a8d-e8a0-4548-a51a-4106620bbd15 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:58.193089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d48f7a8d-e8a0-4548-a51a-4106620bbd15 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1554 microversion: 2.1 time: 0.211696 Jun 22 09:14:58.195068 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 474/989] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:57 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:58.226443 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:58.227044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:58.233944 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:58.234649 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:58.235511 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:58.236008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:58.535306 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:58.543227 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:58.544806 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:58.545973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-36418dfb-b781-4b2f-acb5-9e9f86b747bf tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.324978 Jun 22 09:14:58.546542 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 516/990] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:58 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:14:59.211750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-88688958-c6d1-4c0a-9c61-2d59a7edd06a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:59.212356 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-88688958-c6d1-4c0a-9c61-2d59a7edd06a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:59.219840 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-88688958-c6d1-4c0a-9c61-2d59a7edd06a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:59.220338 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-88688958-c6d1-4c0a-9c61-2d59a7edd06a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:59.221155 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-88688958-c6d1-4c0a-9c61-2d59a7edd06a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:59.221740 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-88688958-c6d1-4c0a-9c61-2d59a7edd06a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:59.361228 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-88688958-c6d1-4c0a-9c61-2d59a7edd06a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:59.368735 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-88688958-c6d1-4c0a-9c61-2d59a7edd06a tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1554 microversion: 2.1 time: 0.160763 Jun 22 09:14:59.369308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 475/991] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:59 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:59.564556 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:59.565242 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:59.572434 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:59.572916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:59.573778 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:59.574224 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:59.739337 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:59.742993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:59.747961 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:59.751697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:59.753451 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-da5390a3-ce53-4ae6-bd10-bfc286e74332 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.192499 Jun 22 09:14:59.753849 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 517/992] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:14:59 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:15:00.131880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:00.132380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:00.138337 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.138792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:00.139586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.140645 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:00.155276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 HTTP/1.1 Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:00.156934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.158494 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '3da0ee91-0da9-40c6-b860-449aebadd656'} Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:00.159437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.160919 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.162475 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:00.162475 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-09823b96-d01e-40eb-bdb1-289643dac4a5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 404 len: 111 microversion: 2.1 time: 0.030264 Jun 22 09:15:00.162475 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 476/993] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:15:00 2022] DELETE /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:00.167219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:00.167842 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 3da0ee91-0da9-40c6-b860-449aebadd656] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:00.175027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.175430 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:00.176204 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.176645 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:00.198522 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 HTTP/1.1 Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:00.200347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.201968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '3da0ee91-0da9-40c6-b860-449aebadd656'} Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:00.202902 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. Jun 22 09:15:00.204425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:00.205770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance 3da0ee91-0da9-40c6-b860-449aebadd656 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:00.205770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e45093c3-7015-4c52-a3bb-9404911a5f52 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656" status: 404 len: 111 microversion: 2.1 time: 0.038869 Jun 22 09:15:00.205770 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 518/994] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:00 2022] GET /compute/v2.1/servers/3da0ee91-0da9-40c6-b860-449aebadd656 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:15:00.391723 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f6b83e84-6d4b-4907-b565-2759888ff6ac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:00.392405 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f6b83e84-6d4b-4907-b565-2759888ff6ac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:00.400180 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f6b83e84-6d4b-4907-b565-2759888ff6ac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.400856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f6b83e84-6d4b-4907-b565-2759888ff6ac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:00.410097 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f6b83e84-6d4b-4907-b565-2759888ff6ac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.410097 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f6b83e84-6d4b-4907-b565-2759888ff6ac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:00.589126 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f6b83e84-6d4b-4907-b565-2759888ff6ac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:00.609446 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f6b83e84-6d4b-4907-b565-2759888ff6ac tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1554 microversion: 2.1 time: 0.220923 Jun 22 09:15:00.610533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 477/995] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:00 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:00.770797 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:00.771790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:00.781022 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.781883 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:00.783044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:00.783499 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.008898 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:01.018536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:01.025735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:01.025735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-85cfb561-15f8-4cee-a7ce-8b85369fa6ab tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1729 microversion: 2.20 time: 0.254759 Jun 22 09:15:01.025735 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 519/996] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:00 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1729 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:15:01.398154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-7803fcab-4f98-4e4f-a6ce-1a342d951af0 req-e9b91f24-8cd2-4335-a533-daa87680e1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93eaaa7c-1a8d-404e-9194-0ef4556feee7", "name": "network-vif-deleted", "tag": "687407a6-7cc6-4eaa-a14c-ef82cef3aa05"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:01.406586 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-7803fcab-4f98-4e4f-a6ce-1a342d951af0 req-e9b91f24-8cd2-4335-a533-daa87680e1e7 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.407065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-7803fcab-4f98-4e4f-a6ce-1a342d951af0 req-e9b91f24-8cd2-4335-a533-daa87680e1e7 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.417886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-7803fcab-4f98-4e4f-a6ce-1a342d951af0 req-e9b91f24-8cd2-4335-a533-daa87680e1e7 service nova] Creating event network-vif-deleted:687407a6-7cc6-4eaa-a14c-ef82cef3aa05 for instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 on hv-cinder-80382 Jun 22 09:15:01.423346 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-7803fcab-4f98-4e4f-a6ce-1a342d951af0 req-e9b91f24-8cd2-4335-a533-daa87680e1e7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028847 Jun 22 09:15:01.423952 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 478/997] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:01.531211 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:01.535603 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:01.539887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.540339 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.541111 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.541552 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.560776 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: DELETE /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e HTTP/1.1 Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:01.562929 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.564280 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'cfc86b4e-da76-47e9-9481-0297e22fb98e'} Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:01.565041 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.566275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.567576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:01.567576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8f767aec-73eb-4d41-a85f-b5c9eb12aae2 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 404 len: 111 microversion: 2.1 time: 0.038149 Jun 22 09:15:01.567576 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 520/998] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:15:01 2022] DELETE /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:01.574202 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:01.574853 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: cfc86b4e-da76-47e9-9481-0297e22fb98e] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:01.583870 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.584349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.585190 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.585797 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.600521 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e HTTP/1.1 Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:01.604445 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.606400 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': 'cfc86b4e-da76-47e9-9481-0297e22fb98e'} Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:01.607485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. Jun 22 09:15:01.608750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.609860 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance cfc86b4e-da76-47e9-9481-0297e22fb98e could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:01.609860 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1185dfac-2689-433e-bd6e-2a7508747f04 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e" status: 404 len: 111 microversion: 2.1 time: 0.034049 Jun 22 09:15:01.609860 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 479/999] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:01 2022] GET /compute/v2.1/servers/cfc86b4e-da76-47e9-9481-0297e22fb98e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:01.612523 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:01.613020 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:01.619145 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.619592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.621359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.621359 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.627179 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-08866cf5-6151-4c32-b93b-17e81f9423de tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:01.631315 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-08866cf5-6151-4c32-b93b-17e81f9423de tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:01.636236 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: DELETE /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 HTTP/1.1 Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:01.637798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.639351 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '27ec2434-e40b-47fc-b565-d465e3fe0f79'} Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:01.640785 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.641967 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.643233 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-08866cf5-6151-4c32-b93b-17e81f9423de tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.643327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:01.643407 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-08866cf5-6151-4c32-b93b-17e81f9423de tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.643493 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d4745dea-aff6-47b4-afda-ba3a7458c5a4 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 404 len: 111 microversion: 2.1 time: 0.030585 Jun 22 09:15:01.643578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-08866cf5-6151-4c32-b93b-17e81f9423de tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.643655 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 521/1000] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:15:01 2022] DELETE /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:01.643743 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-08866cf5-6151-4c32-b93b-17e81f9423de tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.663070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:01.663681 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 27ec2434-e40b-47fc-b565-d465e3fe0f79] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:01.673005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.674373 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.675830 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:01.676464 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:01.692937 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 HTTP/1.1 Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:01.694688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.696165 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '27ec2434-e40b-47fc-b565-d465e3fe0f79'} Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:01.696892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. Jun 22 09:15:01.698072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:01.699376 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance 27ec2434-e40b-47fc-b565-d465e3fe0f79 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:01.699376 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-70412045-9dfb-4474-b13e-2b66fd989614 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79" status: 404 len: 111 microversion: 2.1 time: 0.037856 Jun 22 09:15:01.699376 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 522/1001] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:01 2022] GET /compute/v2.1/servers/27ec2434-e40b-47fc-b565-d465e3fe0f79 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:15:01.730790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-08866cf5-6151-4c32-b93b-17e81f9423de tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6a812133cf437fa3e13f56d1cddd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '476725d6c5c44caebdd8d8e855cc63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:01.754131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-08866cf5-6151-4c32-b93b-17e81f9423de tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 200 len: 1342 microversion: 2.1 time: 0.130666 Jun 22 09:15:01.754925 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 480/1002] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:01 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 1342 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:02.041596 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:02.043479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:02.052046 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:02.052500 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:02.053911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:02.054529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:02.199987 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:02.208152 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:02.209677 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:02.210931 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-df3feba7-e133-4317-9563-57c0d8e881fc tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1716 microversion: 2.20 time: 0.173858 Jun 22 09:15:02.211757 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 523/1003] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:02 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1716 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:15:02.779357 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:02.779967 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] [instance: 93eaaa7c-1a8d-404e-9194-0ef4556feee7] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:02.787081 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:02.787532 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:02.788293 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:02.788737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] HTTP exception thrown: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 could not be found. Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Request method failure captured: Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 HTTP/1.1 Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistzrE02PtXN9Neb4_CsTpef5PFKYhMdrPhFdka3jUNxA7KqjIXLiTVP7m4NYYpY8xp0grE2upaSZBJTaZNgfm3h9P6ZMD4B-DCg-vWUkg2bGb280vYYh5k-JQ_wxDJzKKzty7HWHR6r8_z7VJkzsSODwh15Kgnn-cQE8mhSRztZdkMM Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 476725d6c5c44caebdd8d8e855cc63c6 Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-TestMinimumBasicScenario-125622905 Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:02.803770 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/476725d6c5c44caebdd8d8e855cc63c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_476725d6c5c44caebdd8d8e855cc63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/476725d6c5c44caebdd8d8e855cc63c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/476725d6c5c44caebdd8d8e855cc63c6"}]}] Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-TestMinimumBasicScenario-125622905 Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 476725d6c5c44caebdd8d8e855cc63c6 Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-TestMinimumBasicScenario-125622905 Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-TestMinimumBasicScenario-125622905-project Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 4d6a812133cf437fa3e13f56d1cddd53 Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-TestMinimumBasicScenario-125622905-project Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 could not be found. Jun 22 09:15:02.805455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '93eaaa7c-1a8d-404e-9194-0ef4556feee7'} Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 could not be found. Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:02.806245 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 could not be found. Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 could not be found. Jun 22 09:15:02.807452 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:02.808667 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Returning 404 to user: Instance 93eaaa7c-1a8d-404e-9194-0ef4556feee7 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:02.808667 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a01f0ce7-596f-4f99-9f4c-0c595c9a7980 tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7" status: 404 len: 111 microversion: 2.1 time: 0.029176 Jun 22 09:15:02.808667 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 481/1004] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:02 2022] GET /compute/v2.1/servers/93eaaa7c-1a8d-404e-9194-0ef4556feee7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:02.813937 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2fcd8391-76d4-4215-b83b-78e9063b365e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] Calling method '.version_select at 0x7f500e463670>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:02.942363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2fcd8391-76d4-4215-b83b-78e9063b365e tempest-TestMinimumBasicScenario-125622905 tempest-TestMinimumBasicScenario-125622905-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-939888713" status: 202 len: 0 microversion: 2.1 time: 0.132672 Jun 22 09:15:02.942977 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 524/1005] 10.222.0.55 () {58 vars in 1268 bytes} [Wed Jun 22 09:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-939888713 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:15:03.107963 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:03.108687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:03.114678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:03.115162 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:03.115924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:03.116366 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:03.133543 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 HTTP/1.1 Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:03.135164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.136528 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '139fc621-9e20-4f05-9935-92b048cc48a1'} Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:03.137296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.139124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.141600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:03.141600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-aeed99c2-d1da-4f07-8f91-c1603684cbe7 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 404 len: 111 microversion: 2.1 time: 0.032844 Jun 22 09:15:03.141600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 482/1006] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:15:03 2022] DELETE /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:15:03.146965 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:03.147904 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] [instance: 139fc621-9e20-4f05-9935-92b048cc48a1] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:03.154330 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:03.154797 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:03.155777 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:03.156215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:03.171005 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] HTTP exception thrown: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Request method failure captured: Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 HTTP/1.1 Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistvHv5C7E-G1y-ge4MdMCFXKBaUyMsww6kdm-w-BzghaTYIgke7LLWVrRPrmfJaxSY2kn-sx-NoDEElpPwfUXIYV-zTpKXkVk5uYlx4_CPw5wExVjr4VZ0lxcg5CXeBigySJ0Vtf0-B9EhphHPjdh8MfcGBFDQvB7omiuMgjrUqJlRw Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:03.173151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dfcacaecd4564e90bfc76ff7e77911da"}]}] Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: dfcacaecd4564e90bfc76ff7e77911da Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1831146519 Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 0673a8903f56430f86f87b9447668300 Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeNegativeTest-1831146519-project Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.174473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '139fc621-9e20-4f05-9935-92b048cc48a1'} Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:03.175593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. Jun 22 09:15:03.177117 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:03.178395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] Returning 404 to user: Instance 139fc621-9e20-4f05-9935-92b048cc48a1 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:03.178395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-755aa4fc-db4f-423b-8c4c-9432dd80bad5 tempest-AttachVolumeNegativeTest-1831146519 tempest-AttachVolumeNegativeTest-1831146519-project] 10.222.0.55 "GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1" status: 404 len: 111 microversion: 2.1 time: 0.032228 Jun 22 09:15:03.178395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 525/1007] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:03 2022] GET /compute/v2.1/servers/139fc621-9e20-4f05-9935-92b048cc48a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:10.494663 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fcc919ef-e3ea-425d-ad7f-c310cbdae2d1 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] Action: 'create', calling method: .version_select at 0x7f500e407f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-931734020", "metadata": {"Type": "work"}}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:11.404918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fcc919ef-e3ea-425d-ad7f-c310cbdae2d1 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.158397 Jun 22 09:15:11.417003 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c02256a9-f962-4c50-b228-7ff3b4c6fba0 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] Calling method '.version_select at 0x7f500e4b8f70>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:11.417856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 483/1008] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 22 09:15:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1172 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 09:15:11.495895 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c02256a9-f962-4c50-b228-7ff3b4c6fba0 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de" status: 200 len: 352 microversion: 2.1 time: 0.082665 Jun 22 09:15:11.501426 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 526/1009] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:15:11 2022] GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:11.546432 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-3786f36d-67ab-4341-8dc1-5db3ba3b674b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:11.546987 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3786f36d-67ab-4341-8dc1-5db3ba3b674b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:11.556435 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3786f36d-67ab-4341-8dc1-5db3ba3b674b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:11.559705 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3786f36d-67ab-4341-8dc1-5db3ba3b674b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:11.568864 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3786f36d-67ab-4341-8dc1-5db3ba3b674b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:11.568864 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-3786f36d-67ab-4341-8dc1-5db3ba3b674b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:11.570804 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-254e2812-4c5b-49fc-a35d-e3f5a492ba0d req-65b77fc0-6848-41b2-ace5-e3ac66971cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8edf80c-1741-417f-ad42-4cdf4567898f", "tag": "779d4f23-aa71-4166-aead-3f25b367efc9"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:11.582495 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-254e2812-4c5b-49fc-a35d-e3f5a492ba0d req-65b77fc0-6848-41b2-ace5-e3ac66971cb2 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:11.594720 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-254e2812-4c5b-49fc-a35d-e3f5a492ba0d req-65b77fc0-6848-41b2-ace5-e3ac66971cb2 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:11.636328 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-254e2812-4c5b-49fc-a35d-e3f5a492ba0d req-65b77fc0-6848-41b2-ace5-e3ac66971cb2 service nova] Creating event network-changed:779d4f23-aa71-4166-aead-3f25b367efc9 for instance a8edf80c-1741-417f-ad42-4cdf4567898f on hv-cinder-80382 Jun 22 09:15:11.654425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-254e2812-4c5b-49fc-a35d-e3f5a492ba0d req-65b77fc0-6848-41b2-ace5-e3ac66971cb2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087733 Jun 22 09:15:11.660168 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-3786f36d-67ab-4341-8dc1-5db3ba3b674b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:15:11.661384 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 527/1010] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:11.806922 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:12.043236 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-3786f36d-67ab-4341-8dc1-5db3ba3b674b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 204 len: 0 microversion: 2.1 time: 0.500805 Jun 22 09:15:12.044334 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 484/1011] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:15:11 2022] DELETE /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:15:12.053672 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-364940a6-1171-46aa-bd05-22359058d531 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:12.055079 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-364940a6-1171-46aa-bd05-22359058d531 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:12.061367 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-364940a6-1171-46aa-bd05-22359058d531 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:12.061850 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-364940a6-1171-46aa-bd05-22359058d531 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:12.062686 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-364940a6-1171-46aa-bd05-22359058d531 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:12.063147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-364940a6-1171-46aa-bd05-22359058d531 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:12.227600 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-364940a6-1171-46aa-bd05-22359058d531 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:12.239587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-364940a6-1171-46aa-bd05-22359058d531 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.190103 Jun 22 09:15:12.240183 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 528/1012] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:12 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:12.509826 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7eae0030-2183-4deb-84bb-66689c3167a3 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] Calling method '.version_select at 0x7f500e38bdc0>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:12.573713 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7eae0030-2183-4deb-84bb-66689c3167a3 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de" status: 200 len: 353 microversion: 2.1 time: 0.066673 Jun 22 09:15:12.573713 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 485/1013] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:15:12 2022] GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:12.584137 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-963d30e8-0dc3-4a45-a973-6b804a942c97 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] Calling method '.version_select at 0x7f500e4c3b80>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:12.644174 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-963d30e8-0dc3-4a45-a973-6b804a942c97 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de" status: 200 len: 353 microversion: 2.1 time: 0.063847 Jun 22 09:15:12.644911 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 529/1014] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:15:12 2022] GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:12.657294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-325b899c-8ba8-462f-9f9d-7e10a6ceedaa tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] Calling method '.version_select at 0x7f500e407af0>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:12.876959 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-325b899c-8ba8-462f-9f9d-7e10a6ceedaa tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de" status: 202 len: 0 microversion: 2.1 time: 0.220169 Jun 22 09:15:12.876959 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 486/1015] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:15:12 2022] DELETE /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:15:12.884258 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cdd200a8-3e26-4f22-a723-2fa4686be271 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] Calling method '.version_select at 0x7f500e38a9d0>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:12.938746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cdd200a8-3e26-4f22-a723-2fa4686be271 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de" status: 200 len: 352 microversion: 2.1 time: 0.059600 Jun 22 09:15:12.939688 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 530/1016] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:15:12 2022] GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:13.256889 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4e8bdd03-7f72-49d7-9b1f-7cb049f5ff3e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:13.257863 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4e8bdd03-7f72-49d7-9b1f-7cb049f5ff3e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:13.266143 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4e8bdd03-7f72-49d7-9b1f-7cb049f5ff3e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:13.266775 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4e8bdd03-7f72-49d7-9b1f-7cb049f5ff3e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:13.267742 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4e8bdd03-7f72-49d7-9b1f-7cb049f5ff3e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:13.268345 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4e8bdd03-7f72-49d7-9b1f-7cb049f5ff3e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:13.519007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4e8bdd03-7f72-49d7-9b1f-7cb049f5ff3e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:13.531236 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4e8bdd03-7f72-49d7-9b1f-7cb049f5ff3e tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1568 microversion: 2.1 time: 0.277159 Jun 22 09:15:13.532342 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 487/1017] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:13 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:13.954871 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7926224a-cec9-428b-a3c5-34a7b7e4f054 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] Calling method '.version_select at 0x7f500e2dd280>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:13.987828 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-7926224a-cec9-428b-a3c5-34a7b7e4f054 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] HTTP exception thrown: Volume c2c3423e-f63f-4a0d-a3e7-5563393897de could not be found. Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7926224a-cec9-428b-a3c5-34a7b7e4f054 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] Request method failure captured: Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de HTTP/1.1 Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABist2eqUDLXEboVRav8Zj17o5wtcwioQKvT9j4Qf8Gb-V0lOUbmWVWUqN9t7p_uD5oqtEybIsYL-RUvw56CIkmpNiy2g001sZWr6KK7zZtgy-MJ2LWBOLZ5TUuDX34E4OZcg8Wscdg6Tl0ePjwHhNnqdZYGB-x6ZaXH8U46-Q8NczsyZ0 Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: af1d6c5e5dd94cb7bc39469855ce522d Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesGetTestJSON-1347577568 Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:13.990147 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/af1d6c5e5dd94cb7bc39469855ce522d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_af1d6c5e5dd94cb7bc39469855ce522d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af1d6c5e5dd94cb7bc39469855ce522d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/af1d6c5e5dd94cb7bc39469855ce522d"}]}] Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesGetTestJSON-1347577568 Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: af1d6c5e5dd94cb7bc39469855ce522d Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesGetTestJSON-1347577568 Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesGetTestJSON-1347577568-project Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 6ad3ff4afc3b4a63859f832645df15f5 Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesGetTestJSON-1347577568-project Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Volume c2c3423e-f63f-4a0d-a3e7-5563393897de could not be found. Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'c2c3423e-f63f-4a0d-a3e7-5563393897de'} Jun 22 09:15:13.991546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2c3423e-f63f-4a0d-a3e7-5563393897de could not be found. (HTTP 404) (Request-ID: req-301a09af-559f-4933-8cfd-db1af4e3bae1) Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:13.992466 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:15:13.993730 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2c3423e-f63f-4a0d-a3e7-5563393897de could not be found. Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:15:13.998432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2c3423e-f63f-4a0d-a3e7-5563393897de could not be found. Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2c3423e-f63f-4a0d-a3e7-5563393897de could not be found. Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7926224a-cec9-428b-a3c5-34a7b7e4f054 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] Returning 404 to user: Volume c2c3423e-f63f-4a0d-a3e7-5563393897de could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7926224a-cec9-428b-a3c5-34a7b7e4f054 tempest-VolumesGetTestJSON-1347577568 tempest-VolumesGetTestJSON-1347577568-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de" status: 404 len: 109 microversion: 2.1 time: 0.042370 Jun 22 09:15:14.005348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 531/1018] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:15:13 2022] GET /compute/v2.1/os-volumes/c2c3423e-f63f-4a0d-a3e7-5563393897de => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:14.414070 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-520086b9-a063-4d6b-bc4a-c3945eb8c371 req-8efcfdf2-4956-4336-9258-fd0133d5e961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8edf80c-1741-417f-ad42-4cdf4567898f", "name": "network-vif-deleted", "tag": "779d4f23-aa71-4166-aead-3f25b367efc9"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:14.424398 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-520086b9-a063-4d6b-bc4a-c3945eb8c371 req-8efcfdf2-4956-4336-9258-fd0133d5e961 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:14.424837 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-520086b9-a063-4d6b-bc4a-c3945eb8c371 req-8efcfdf2-4956-4336-9258-fd0133d5e961 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:14.443180 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-520086b9-a063-4d6b-bc4a-c3945eb8c371 req-8efcfdf2-4956-4336-9258-fd0133d5e961 service nova] Creating event network-vif-deleted:779d4f23-aa71-4166-aead-3f25b367efc9 for instance a8edf80c-1741-417f-ad42-4cdf4567898f on hv-cinder-80382 Jun 22 09:15:14.448038 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-520086b9-a063-4d6b-bc4a-c3945eb8c371 req-8efcfdf2-4956-4336-9258-fd0133d5e961 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037570 Jun 22 09:15:14.448957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 488/1019] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:14.550110 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-301752c8-dfaa-49de-80f0-273faaddc0da tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:14.550569 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-301752c8-dfaa-49de-80f0-273faaddc0da tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:14.558002 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-301752c8-dfaa-49de-80f0-273faaddc0da tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:14.558460 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-301752c8-dfaa-49de-80f0-273faaddc0da tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:14.559242 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-301752c8-dfaa-49de-80f0-273faaddc0da tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:14.559677 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-301752c8-dfaa-49de-80f0-273faaddc0da tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:14.636393 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-301752c8-dfaa-49de-80f0-273faaddc0da tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:14.646427 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-301752c8-dfaa-49de-80f0-273faaddc0da tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1382 microversion: 2.1 time: 0.101073 Jun 22 09:15:14.647232 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 532/1020] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:14 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1382 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:15.675909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-00b092a9-d6e5-48c6-9692-5a504321db8f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:15.676615 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-00b092a9-d6e5-48c6-9692-5a504321db8f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:15.683406 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00b092a9-d6e5-48c6-9692-5a504321db8f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:15.683855 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00b092a9-d6e5-48c6-9692-5a504321db8f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:15.684622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00b092a9-d6e5-48c6-9692-5a504321db8f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:15.685227 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-00b092a9-d6e5-48c6-9692-5a504321db8f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:15.753987 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-00b092a9-d6e5-48c6-9692-5a504321db8f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7bc17464f3346d0aba238a2dee0dc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:15.763168 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-00b092a9-d6e5-48c6-9692-5a504321db8f tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 200 len: 1219 microversion: 2.1 time: 0.099385 Jun 22 09:15:15.764033 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 489/1021] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:15 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:16.781478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:16.782107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] [instance: a8edf80c-1741-417f-ad42-4cdf4567898f] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:16.788955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:16.790647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:16.790647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:16.790647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:16.804091 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] HTTP exception thrown: Instance a8edf80c-1741-417f-ad42-4cdf4567898f could not be found. Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Request method failure captured: Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f HTTP/1.1 Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistxeRTw0VMqphB51iDMQu9dAHVIieANncLfKkuBK5UOs6Blqm01va6lvD-22uunyDvb9rxT1izDt0UH3joHq5qevlzmavDXZACe8J23j81RFkrwVW49BXK0IKqWsittOljtWeodmcLh1VoXE6RRIK1dpbo14VtIWVbl6Id0DvIbsLQE Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: ed7f3e35bb9a4f2ea707996c3c46acfb Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-TestShelveInstance-1897395612 Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:16.805782 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ed7f3e35bb9a4f2ea707996c3c46acfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ed7f3e35bb9a4f2ea707996c3c46acfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed7f3e35bb9a4f2ea707996c3c46acfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ed7f3e35bb9a4f2ea707996c3c46acfb"}]}] Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-TestShelveInstance-1897395612 Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: ed7f3e35bb9a4f2ea707996c3c46acfb Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-TestShelveInstance-1897395612 Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-TestShelveInstance-1897395612-project Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: a7bc17464f3346d0aba238a2dee0dc47 Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-TestShelveInstance-1897395612-project Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance a8edf80c-1741-417f-ad42-4cdf4567898f could not be found. Jun 22 09:15:16.807593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'a8edf80c-1741-417f-ad42-4cdf4567898f'} Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8edf80c-1741-417f-ad42-4cdf4567898f could not be found. Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:16.808469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8edf80c-1741-417f-ad42-4cdf4567898f could not be found. Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8edf80c-1741-417f-ad42-4cdf4567898f could not be found. Jun 22 09:15:16.809955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:16.811473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Returning 404 to user: Instance a8edf80c-1741-417f-ad42-4cdf4567898f could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:16.811473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1d647261-d876-4605-81c8-cb3c528fe21b tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f" status: 404 len: 111 microversion: 2.1 time: 0.030284 Jun 22 09:15:16.811473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 533/1022] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:16 2022] GET /compute/v2.1/servers/a8edf80c-1741-417f-ad42-4cdf4567898f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:17.034331 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3a8d4452-ad32-42e3-9b55-0a2282b59500 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] Calling method '.version_select at 0x7f500e5d7ca0>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:17.148125 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3a8d4452-ad32-42e3-9b55-0a2282b59500 tempest-TestShelveInstance-1897395612 tempest-TestShelveInstance-1897395612-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1826857514" status: 202 len: 0 microversion: 2.1 time: 0.118368 Jun 22 09:15:17.148707 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 534/1023] 10.222.0.55 () {58 vars in 1253 bytes} [Wed Jun 22 09:15:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1826857514 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:15:17.159741 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-95baa5d8-016c-4f19-9d11-e221b60e6a77 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Action: 'create', calling method: .version_select at 0x7f500e53f790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-96687983", "metadata": {"Type": "work"}}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-95baa5d8-016c-4f19-9d11-e221b60e6a77 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Request method failure captured: Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 120 Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABist2kI38DkoP9YfcjXUgbPo-aEgyjqsotrnjjbt3q1380Dr7EEmh048Vqx5W70ehHqyLfCv4cW_tKdwaj3MZdWOGn8ENTVJAviAf-O438u3cRG7DwyJM_s_JpahxJE5a4X4ROyliMc9zozU286EnSWLzDBrMPBDYsaycORLFHePaWlE8 Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:17.187865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}] Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 617384eba556402c9b8a970f2012917d Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-96687983", "metadata": {"Type": "work"}}} Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: Jun 22 09:15:17.196798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-96687983', 'metadata': {'Type': 'work'}}}} Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise error Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:17.197703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 09:15:17.199129 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 09:15:17.200312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 09:15:17.200312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.200312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-95baa5d8-016c-4f19-9d11-e221b60e6a77 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:17.200312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-95baa5d8-016c-4f19-9d11-e221b60e6a77 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.256425 Jun 22 09:15:17.200312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 490/1024] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 22 09:15:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:15:17.206697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-075b9f3f-0fc6-4dc3-a1c4-f37927bb97a6 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Action: 'create', calling method: .version_select at 0x7f500e4c3550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-495469587", "metadata": {"Type": "work"}}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-075b9f3f-0fc6-4dc3-a1c4-f37927bb97a6 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Request method failure captured: Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 119 Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABist2kI38DkoP9YfcjXUgbPo-aEgyjqsotrnjjbt3q1380Dr7EEmh048Vqx5W70ehHqyLfCv4cW_tKdwaj3MZdWOGn8ENTVJAviAf-O438u3cRG7DwyJM_s_JpahxJE5a4X4ROyliMc9zozU286EnSWLzDBrMPBDYsaycORLFHePaWlE8 Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:17.216122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}] Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 617384eba556402c9b8a970f2012917d Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-495469587", "metadata": {"Type": "work"}}} Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: Jun 22 09:15:17.217528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-495469587', 'metadata': {'Type': 'work'}}}} Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise error Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi '0' Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:17.218432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 09:15:17.220910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 09:15:17.226982 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 09:15:17.226982 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.226982 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-075b9f3f-0fc6-4dc3-a1c4-f37927bb97a6 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:17.226982 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-075b9f3f-0fc6-4dc3-a1c4-f37927bb97a6 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015449 Jun 22 09:15:17.226982 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 535/1025] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 22 09:15:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:15:17.237520 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fd75a5bc-30ad-40b4-93fa-8f276868f405 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Action: 'create', calling method: .version_select at 0x7f500e3db310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-749387641", "metadata": {"Type": "work"}}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fd75a5bc-30ad-40b4-93fa-8f276868f405 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Request method failure captured: Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 118 Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABist2kI38DkoP9YfcjXUgbPo-aEgyjqsotrnjjbt3q1380Dr7EEmh048Vqx5W70ehHqyLfCv4cW_tKdwaj3MZdWOGn8ENTVJAviAf-O438u3cRG7DwyJM_s_JpahxJE5a4X4ROyliMc9zozU286EnSWLzDBrMPBDYsaycORLFHePaWlE8 Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:17.239917 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}] Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 617384eba556402c9b8a970f2012917d Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-749387641", "metadata": {"Type": "work"}}} Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: Jun 22 09:15:17.241253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-749387641', 'metadata': {'Type': 'work'}}}} Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise error Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi '' Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:17.242737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 09:15:17.245303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 09:15:17.248687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 09:15:17.248687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.248687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-fd75a5bc-30ad-40b4-93fa-8f276868f405 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:17.248687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-fd75a5bc-30ad-40b4-93fa-8f276868f405 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007540 Jun 22 09:15:17.248687 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 491/1026] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 22 09:15:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:15:17.254882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-91bc8741-6efa-4a79-90bb-0891b5c4f04b tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Calling method '.version_select at 0x7f500e5f9af0>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:17.286960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-91bc8741-6efa-4a79-90bb-0891b5c4f04b tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] HTTP exception thrown: Volume tempest-invalid-1412337152 could not be found. Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-91bc8741-6efa-4a79-90bb-0891b5c4f04b tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Request method failure captured: Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1412337152 HTTP/1.1 Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABist2kI38DkoP9YfcjXUgbPo-aEgyjqsotrnjjbt3q1380Dr7EEmh048Vqx5W70ehHqyLfCv4cW_tKdwaj3MZdWOGn8ENTVJAviAf-O438u3cRG7DwyJM_s_JpahxJE5a4X4ROyliMc9zozU286EnSWLzDBrMPBDYsaycORLFHePaWlE8 Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:17.289036 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}] Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 617384eba556402c9b8a970f2012917d Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Volume tempest-invalid-1412337152 could not be found. Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'tempest-invalid-1412337152'} Jun 22 09:15:17.290408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1412337152 could not be found. (HTTP 404) (Request-ID: req-399b79c0-ea13-468a-994d-bf634878b422) Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.291259 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:15:17.293083 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1412337152 could not be found. Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:17.294618 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1412337152 could not be found. Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1412337152 could not be found. Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-91bc8741-6efa-4a79-90bb-0891b5c4f04b tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Returning 404 to user: Volume tempest-invalid-1412337152 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-91bc8741-6efa-4a79-90bb-0891b5c4f04b tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1412337152" status: 404 len: 99 microversion: 2.1 time: 0.041628 Jun 22 09:15:17.296243 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 536/1027] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 22 09:15:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1412337152 => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 22 09:15:17.303513 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9204c2c9-9024-4630-ba3a-21dc2e10c0da tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003998 Jun 22 09:15:17.309521 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 492/1028] 10.222.0.55 () {58 vars in 1139 bytes} [Wed Jun 22 09:15:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 09:15:17.315859 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7ff6b3d0-c80d-44f9-b2c6-0bbe3f7516f0 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004305 Jun 22 09:15:17.319319 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 537/1029] 10.222.0.55 () {58 vars in 1136 bytes} [Wed Jun 22 09:15:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 09:15:17.327695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-450b9ba4-7474-49b5-be10-76cb4cd2dc41 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Calling method '.version_select at 0x7f500e2f0310>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:17.360629 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-450b9ba4-7474-49b5-be10-76cb4cd2dc41 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] HTTP exception thrown: Volume 79e89881-b9bc-465a-b186-3419aae01710 could not be found. Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-450b9ba4-7474-49b5-be10-76cb4cd2dc41 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Request method failure captured: Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/os-volumes/79e89881-b9bc-465a-b186-3419aae01710 HTTP/1.1 Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABist2kI38DkoP9YfcjXUgbPo-aEgyjqsotrnjjbt3q1380Dr7EEmh048Vqx5W70ehHqyLfCv4cW_tKdwaj3MZdWOGn8ENTVJAviAf-O438u3cRG7DwyJM_s_JpahxJE5a4X4ROyliMc9zozU286EnSWLzDBrMPBDYsaycORLFHePaWlE8 Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:17.363820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}] Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 617384eba556402c9b8a970f2012917d Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Volume 79e89881-b9bc-465a-b186-3419aae01710 could not be found. Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '79e89881-b9bc-465a-b186-3419aae01710'} Jun 22 09:15:17.365263 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79e89881-b9bc-465a-b186-3419aae01710 could not be found. (HTTP 404) (Request-ID: req-b947b136-f7b9-4ff8-8433-ae8c423eb53e) Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.366053 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:15:17.367349 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79e89881-b9bc-465a-b186-3419aae01710 could not be found. Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 09:15:17.368466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79e89881-b9bc-465a-b186-3419aae01710 could not be found. Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79e89881-b9bc-465a-b186-3419aae01710 could not be found. Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-450b9ba4-7474-49b5-be10-76cb4cd2dc41 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Returning 404 to user: Volume 79e89881-b9bc-465a-b186-3419aae01710 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:17.369804 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-450b9ba4-7474-49b5-be10-76cb4cd2dc41 tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/79e89881-b9bc-465a-b186-3419aae01710" status: 404 len: 109 microversion: 2.1 time: 0.042485 Jun 22 09:15:17.370727 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 493/1030] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 22 09:15:17 2022] DELETE /compute/v2.1/os-volumes/79e89881-b9bc-465a-b186-3419aae01710 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:17.376352 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a6c92f14-d678-40fb-816c-67c67f71a18e tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Calling method '.version_select at 0x7f500e5d7d30>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:17.404640 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-a6c92f14-d678-40fb-816c-67c67f71a18e tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] HTTP exception thrown: Volume bb6a9d2e-f383-4726-b8a9-4061d5e386bc could not be found. Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a6c92f14-d678-40fb-816c-67c67f71a18e tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Request method failure captured: Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/os-volumes/bb6a9d2e-f383-4726-b8a9-4061d5e386bc HTTP/1.1 Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABist2kI38DkoP9YfcjXUgbPo-aEgyjqsotrnjjbt3q1380Dr7EEmh048Vqx5W70ehHqyLfCv4cW_tKdwaj3MZdWOGn8ENTVJAviAf-O438u3cRG7DwyJM_s_JpahxJE5a4X4ROyliMc9zozU286EnSWLzDBrMPBDYsaycORLFHePaWlE8 Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:17.406906 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/91361ce05ac44b308cc23a658cbfc221"}]}] Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 91361ce05ac44b308cc23a658cbfc221 Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesNegativeTest-1607592888 Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 617384eba556402c9b8a970f2012917d Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesNegativeTest-1607592888-project Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Volume bb6a9d2e-f383-4726-b8a9-4061d5e386bc could not be found. Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'bb6a9d2e-f383-4726-b8a9-4061d5e386bc'} Jun 22 09:15:17.408432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb6a9d2e-f383-4726-b8a9-4061d5e386bc could not be found. (HTTP 404) (Request-ID: req-1b206d95-c9fc-4fbf-92c7-31e4b7d5df17) Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.409372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:15:17.410812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb6a9d2e-f383-4726-b8a9-4061d5e386bc could not be found. Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:15:17.412175 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb6a9d2e-f383-4726-b8a9-4061d5e386bc could not be found. Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb6a9d2e-f383-4726-b8a9-4061d5e386bc could not be found. Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a6c92f14-d678-40fb-816c-67c67f71a18e tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] Returning 404 to user: Volume bb6a9d2e-f383-4726-b8a9-4061d5e386bc could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:17.413601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a6c92f14-d678-40fb-816c-67c67f71a18e tempest-VolumesNegativeTest-1607592888 tempest-VolumesNegativeTest-1607592888-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/bb6a9d2e-f383-4726-b8a9-4061d5e386bc" status: 404 len: 109 microversion: 2.1 time: 0.038056 Jun 22 09:15:17.417241 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 538/1031] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 22 09:15:17 2022] GET /compute/v2.1/os-volumes/bb6a9d2e-f383-4726-b8a9-4061d5e386bc => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:37.707026 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:37.707797 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:37.712095 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d0936684-c1f4-428a-b537-181c84ee1f36 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:37.713011 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d0936684-c1f4-428a-b537-181c84ee1f36 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:37.719873 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d0936684-c1f4-428a-b537-181c84ee1f36 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:37.720312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d0936684-c1f4-428a-b537-181c84ee1f36 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:37.721061 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d0936684-c1f4-428a-b537-181c84ee1f36 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:37.721533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d0936684-c1f4-428a-b537-181c84ee1f36 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:37.752901 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d0936684-c1f4-428a-b537-181c84ee1f36 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047447 Jun 22 09:15:37.753442 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 494/1032] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 22 09:15:37 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:37.809678 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=38 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:37.810421 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:37.814839 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-88747a80-0b29-4c65-9344-47a3154706ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:37.815337 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-88747a80-0b29-4c65-9344-47a3154706ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:37.821291 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-88747a80-0b29-4c65-9344-47a3154706ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:37.823705 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-88747a80-0b29-4c65-9344-47a3154706ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:37.823705 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-88747a80-0b29-4c65-9344-47a3154706ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:37.823705 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-88747a80-0b29-4c65-9344-47a3154706ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:37.847226 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-88747a80-0b29-4c65-9344-47a3154706ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Going to try to terminate instance {{(pid=118268) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:15:38.124325 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-88747a80-0b29-4c65-9344-47a3154706ac tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 204 len: 0 microversion: 2.20 time: 0.315949 Jun 22 09:15:38.124917 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 539/1033] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 22 09:15:37 2022] DELETE /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:15:38.133684 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:38.134294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:38.142352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:38.142800 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:38.143609 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:38.144072 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:38.273426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:38.281905 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:38.283426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:38.284580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7d552a6e-1db1-4050-b7f2-ea482b96de61 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.154964 Jun 22 09:15:38.285159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 495/1034] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:38 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:15:38.548354 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-290223873", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452"}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:38.604786 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] validate_networks() for None {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:15:38.888344 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:15:38.888910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:15:38.889233 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:15:38.889633 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:15:38.890037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:15:38.899181 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:38.899571 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:38.900392 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:38.900827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:38.917578 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Getting quotas for project f6349c1f0e374b0b87f64a45509f2660. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:15:38.921481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Getting quotas for user 01940c2ed024495d88541ca830b4d391 and project f6349c1f0e374b0b87f64a45509f2660. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:15:38.933152 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:15:38.935601 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:15:39.054602 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [c4fa2c05-4ae7-4197-88f8-81ee96436657] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 09:15:39.304052 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:39.304648 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:39.311628 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:39.312066 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:39.313457 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:39.313883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:39.440573 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:39.448348 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:39.449834 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:39.451007 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d6d9ef37-81b4-46f0-b757-993a64a23ae3 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.151395 Jun 22 09:15:39.451557 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 496/1035] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:39 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:15:40.061819 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO oslo.messaging._drivers.impl_rabbit [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [c4fa2c05-4ae7-4197-88f8-81ee96436657] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 60306. Jun 22 09:15:40.065671 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-34dcd525-b5a4-4e01-a1eb-2d191661925e tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522290 Jun 22 09:15:40.066348 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 540/1036] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:15:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:15:40.076028 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-7f910a22-77a2-4b83-98db-d44b2a5c67a5 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:40.076641 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-7f910a22-77a2-4b83-98db-d44b2a5c67a5 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:40.131017 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-7f910a22-77a2-4b83-98db-d44b2a5c67a5 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:40.137640 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-7f910a22-77a2-4b83-98db-d44b2a5c67a5 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1214 microversion: 2.1 time: 0.065377 Jun 22 09:15:40.138233 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 497/1037] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:40 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:40.469479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:40.470078 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:40.476858 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:40.477298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:40.478043 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:40.478471 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:40.614624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:40.615883 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:40.617492 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:40.618587 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-21566bf6-9b58-41e1-ae00-9756d753bffd tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.153563 Jun 22 09:15:40.619172 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 541/1038] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:40 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:15:41.154846 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-28587e94-3ce8-45a8-954e-e22827dbfcd3 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:41.155441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-28587e94-3ce8-45a8-954e-e22827dbfcd3 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:41.207884 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-28587e94-3ce8-45a8-954e-e22827dbfcd3 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:41.214345 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-28587e94-3ce8-45a8-954e-e22827dbfcd3 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1214 microversion: 2.1 time: 0.063409 Jun 22 09:15:41.214915 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 498/1039] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:41 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:41.636685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:41.637223 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:41.643745 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:41.644191 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:41.644944 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:41.645374 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:41.771880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:41.779716 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:41.781726 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:41.782896 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-76f0ff68-37f7-42e2-985c-e2ab258bb44e tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1722 microversion: 2.20 time: 0.150139 Jun 22 09:15:41.783457 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 542/1040] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:41 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:15:42.230642 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-86e20eb6-30c0-4283-8364-871ede1cd077 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:42.231419 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-86e20eb6-30c0-4283-8364-871ede1cd077 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:42.301647 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-86e20eb6-30c0-4283-8364-871ede1cd077 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:42.309190 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-86e20eb6-30c0-4283-8364-871ede1cd077 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1214 microversion: 2.1 time: 0.082997 Jun 22 09:15:42.309900 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 499/1041] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:42 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:42.801182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:42.801793 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:42.808411 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:42.808912 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:42.809685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:42.810122 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:42.882262 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:42.886615 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:42.888324 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:42.889482 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8938aa1b-b887-43e7-b649-3aa24ab17853 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1656 microversion: 2.20 time: 0.092412 Jun 22 09:15:42.890287 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 543/1042] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:42 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:15:43.047405 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-850705bc-0285-439d-986b-f9394ec20122 req-77a54027-2790-4852-88cd-66546f92e21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88cfdf9-1c62-4867-ae38-32484e4b2fdd", "name": "network-vif-deleted", "tag": "80ee4f92-8e74-49ff-9d1e-85edcc14992c"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:43.056460 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-850705bc-0285-439d-986b-f9394ec20122 req-77a54027-2790-4852-88cd-66546f92e21b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:43.056973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-850705bc-0285-439d-986b-f9394ec20122 req-77a54027-2790-4852-88cd-66546f92e21b service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:43.070507 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-850705bc-0285-439d-986b-f9394ec20122 req-77a54027-2790-4852-88cd-66546f92e21b service nova] Creating event network-vif-deleted:80ee4f92-8e74-49ff-9d1e-85edcc14992c for instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd on hv-cinder-80382 Jun 22 09:15:43.074760 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-850705bc-0285-439d-986b-f9394ec20122 req-77a54027-2790-4852-88cd-66546f92e21b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032239 Jun 22 09:15:43.075574 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 500/1043] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:43.325389 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e92a3ed2-1b87-428e-85d2-65a921e74f14 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:43.325995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e92a3ed2-1b87-428e-85d2-65a921e74f14 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:43.384668 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e92a3ed2-1b87-428e-85d2-65a921e74f14 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:43.391657 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e92a3ed2-1b87-428e-85d2-65a921e74f14 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1214 microversion: 2.1 time: 0.069996 Jun 22 09:15:43.392227 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 544/1044] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:43 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:43.911331 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:43.912550 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:43.918887 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:43.922259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:43.922259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:43.922259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:43.951856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:43.952296 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:43.952736 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lazy-loading 'fault' on Instance uuid e88cfdf9-1c62-4867-ae38-32484e4b2fdd {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:15:43.997177 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:44.009647 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:44.011181 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3e567058964720964d98e76e55e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd77392b924e64ba52350c775cf638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:44.012345 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d08aa4e3-1b10-4112-8d4b-d5f6ec2a3207 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 200 len: 1371 microversion: 2.20 time: 0.107846 Jun 22 09:15:44.012900 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 501/1045] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:43 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:15:44.408044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e0ce946a-55ab-438d-b60c-7db68e3860dc tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:44.408674 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e0ce946a-55ab-438d-b60c-7db68e3860dc tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:44.416001 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0ce946a-55ab-438d-b60c-7db68e3860dc tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:44.416447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0ce946a-55ab-438d-b60c-7db68e3860dc tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:44.417204 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0ce946a-55ab-438d-b60c-7db68e3860dc tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:44.417634 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-e0ce946a-55ab-438d-b60c-7db68e3860dc tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:44.476298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e0ce946a-55ab-438d-b60c-7db68e3860dc tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:44.483743 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e0ce946a-55ab-438d-b60c-7db68e3860dc tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1218 microversion: 2.1 time: 0.079666 Jun 22 09:15:44.484792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 545/1046] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:44 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:45.036242 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:45.036759 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:45.043098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:45.043540 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:45.044287 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:45.044715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:45.058603 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] HTTP exception thrown: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Request method failure captured: Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd HTTP/1.1 Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistwZpJO17DX3MPEAArFqM1_jwUeRKWTmEffKF4aFNHuQ4QnFSsLvJ37SwfqQD8h24jf7IHcyDoY-T071N9F4q0tDgYG7nqSK-XhdNu8y77ermls-0I1IpsPKBo9y0AF6abtW3bCOgQ99pMvow6r2bmDkUlGZTncTF0XjZ9LwvkkbpK4 Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:45.060319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/27cd77392b924e64ba52350c775cf638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_27cd77392b924e64ba52350c775cf638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}] Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 8e3e567058964720964d98e76e55e462 Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:45.062131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': 'e88cfdf9-1c62-4867-ae38-32484e4b2fdd'} Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:45.063125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:45.064644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:45.065992 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Returning 404 to user: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:45.065992 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cdeca38e-7636-4d5f-a811-3a58f7b66706 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 404 len: 111 microversion: 2.20 time: 0.029415 Jun 22 09:15:45.065992 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 502/1047] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:45 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:15:45.071244 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-91d75b55-f4a8-4862-bc4a-6ee2f82bcb86 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '.version_select at 0x7f500e38a5e0>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:45.142526 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-91d75b55-f4a8-4862-bc4a-6ee2f82bcb86 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139394018" status: 204 len: 0 microversion: 2.20 time: 0.075297 Jun 22 09:15:45.143163 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 546/1048] 10.222.0.55 () {60 vars in 1261 bytes} [Wed Jun 22 09:15:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139394018 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:15:45.501285 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4d61d445-08af-49cf-b033-fa32100c8509 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:45.501896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4d61d445-08af-49cf-b033-fa32100c8509 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:45.507888 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d61d445-08af-49cf-b033-fa32100c8509 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:45.508335 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d61d445-08af-49cf-b033-fa32100c8509 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:45.509086 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d61d445-08af-49cf-b033-fa32100c8509 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:45.509526 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d61d445-08af-49cf-b033-fa32100c8509 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:45.576781 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4d61d445-08af-49cf-b033-fa32100c8509 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:45.584781 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4d61d445-08af-49cf-b033-fa32100c8509 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1218 microversion: 2.1 time: 0.087887 Jun 22 09:15:45.585338 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 503/1049] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:45 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:46.602008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-35b4f2df-16c1-48eb-80b7-95bb6708518b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:46.602705 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-35b4f2df-16c1-48eb-80b7-95bb6708518b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:46.610313 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-35b4f2df-16c1-48eb-80b7-95bb6708518b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:46.610752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-35b4f2df-16c1-48eb-80b7-95bb6708518b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:46.611534 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-35b4f2df-16c1-48eb-80b7-95bb6708518b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:46.611965 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-35b4f2df-16c1-48eb-80b7-95bb6708518b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:46.672689 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-35b4f2df-16c1-48eb-80b7-95bb6708518b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:46.680019 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-35b4f2df-16c1-48eb-80b7-95bb6708518b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1218 microversion: 2.1 time: 0.082364 Jun 22 09:15:46.680573 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 547/1050] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:46 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:47.696709 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-eeddb01b-ae4d-40d5-8460-7d09199d2350 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:47.697318 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-eeddb01b-ae4d-40d5-8460-7d09199d2350 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:47.704083 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eeddb01b-ae4d-40d5-8460-7d09199d2350 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:47.704536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eeddb01b-ae4d-40d5-8460-7d09199d2350 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:47.705295 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eeddb01b-ae4d-40d5-8460-7d09199d2350 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:47.705731 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-eeddb01b-ae4d-40d5-8460-7d09199d2350 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:47.767272 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-eeddb01b-ae4d-40d5-8460-7d09199d2350 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:47.774566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-eeddb01b-ae4d-40d5-8460-7d09199d2350 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1210 microversion: 2.1 time: 0.081699 Jun 22 09:15:47.775159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 504/1051] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:47 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:48.792273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d0f79335-bcce-4134-a719-23f7fa17a023 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:48.792916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d0f79335-bcce-4134-a719-23f7fa17a023 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:48.799453 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d0f79335-bcce-4134-a719-23f7fa17a023 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:48.799914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d0f79335-bcce-4134-a719-23f7fa17a023 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:48.800663 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d0f79335-bcce-4134-a719-23f7fa17a023 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:48.801139 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d0f79335-bcce-4134-a719-23f7fa17a023 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:48.866141 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d0f79335-bcce-4134-a719-23f7fa17a023 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:48.873558 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d0f79335-bcce-4134-a719-23f7fa17a023 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1266 microversion: 2.1 time: 0.085451 Jun 22 09:15:48.874186 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 548/1052] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:48 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:49.316598 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:49.317164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:49.323991 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:49.327237 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:49.327237 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:49.327237 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:49.340859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] HTTP exception thrown: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Request method failure captured: Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd HTTP/1.1 Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistwZpJO17DX3MPEAArFqM1_jwUeRKWTmEffKF4aFNHuQ4QnFSsLvJ37SwfqQD8h24jf7IHcyDoY-T071N9F4q0tDgYG7nqSK-XhdNu8y77ermls-0I1IpsPKBo9y0AF6abtW3bCOgQ99pMvow6r2bmDkUlGZTncTF0XjZ9LwvkkbpK4 Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:49.342537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/27cd77392b924e64ba52350c775cf638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_27cd77392b924e64ba52350c775cf638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}] Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 8e3e567058964720964d98e76e55e462 Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.344851 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': 'e88cfdf9-1c62-4867-ae38-32484e4b2fdd'} Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:49.345818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.347422 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.348806 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Returning 404 to user: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:49.348806 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5de8d878-0252-46f2-887a-57cef57ae1df tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 404 len: 111 microversion: 2.20 time: 0.033069 Jun 22 09:15:49.350894 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 505/1053] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 22 09:15:49 2022] DELETE /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:15:49.353566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:49.354298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: e88cfdf9-1c62-4867-ae38-32484e4b2fdd] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:49.356630 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:49.362316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:49.362762 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:49.363718 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:49.364148 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:49.378668 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] HTTP exception thrown: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Request method failure captured: Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd HTTP/1.1 Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistwZpJO17DX3MPEAArFqM1_jwUeRKWTmEffKF4aFNHuQ4QnFSsLvJ37SwfqQD8h24jf7IHcyDoY-T071N9F4q0tDgYG7nqSK-XhdNu8y77ermls-0I1IpsPKBo9y0AF6abtW3bCOgQ99pMvow6r2bmDkUlGZTncTF0XjZ9LwvkkbpK4 Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:49.381301 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/27cd77392b924e64ba52350c775cf638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_27cd77392b924e64ba52350c775cf638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}] Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 8e3e567058964720964d98e76e55e462 Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.382784 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'e88cfdf9-1c62-4867-ae38-32484e4b2fdd'} Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:49.383708 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. Jun 22 09:15:49.385158 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:49.386696 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Returning 404 to user: Instance e88cfdf9-1c62-4867-ae38-32484e4b2fdd could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:49.386696 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5c106921-739c-488f-a3f3-a204a655a80b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd" status: 404 len: 111 microversion: 2.20 time: 0.032309 Jun 22 09:15:49.387505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 549/1054] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:49 2022] GET /compute/v2.1/servers/e88cfdf9-1c62-4867-ae38-32484e4b2fdd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:15:49.891947 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e19f9ad0-8478-4ff7-83b1-355aca26440f tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:49.892629 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e19f9ad0-8478-4ff7-83b1-355aca26440f tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:49.898779 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e19f9ad0-8478-4ff7-83b1-355aca26440f tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:49.899260 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e19f9ad0-8478-4ff7-83b1-355aca26440f tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:49.900040 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e19f9ad0-8478-4ff7-83b1-355aca26440f tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:49.900467 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e19f9ad0-8478-4ff7-83b1-355aca26440f tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:49.970013 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e19f9ad0-8478-4ff7-83b1-355aca26440f tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:49.977911 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e19f9ad0-8478-4ff7-83b1-355aca26440f tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1272 microversion: 2.1 time: 0.090531 Jun 22 09:15:49.978599 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 506/1055] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:49 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:15:50.663273 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:50.663819 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:50.670741 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:50.671219 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:50.671984 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:50.672421 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:50.688725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] HTTP exception thrown: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Request method failure captured: Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: DELETE /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 HTTP/1.1 Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABistwZpJO17DX3MPEAArFqM1_jwUeRKWTmEffKF4aFNHuQ4QnFSsLvJ37SwfqQD8h24jf7IHcyDoY-T071N9F4q0tDgYG7nqSK-XhdNu8y77ermls-0I1IpsPKBo9y0AF6abtW3bCOgQ99pMvow6r2bmDkUlGZTncTF0XjZ9LwvkkbpK4 Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:15:50.690304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/27cd77392b924e64ba52350c775cf638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_27cd77392b924e64ba52350c775cf638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}] Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 8e3e567058964720964d98e76e55e462 Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.691960 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '04c02245-d347-4fe2-8836-ca64aeb90e74'} Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:50.692767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.694432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.698710 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Returning 404 to user: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:50.698710 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-098885aa-8351-4e30-a64a-2960ea606450 tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "DELETE /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 404 len: 111 microversion: 2.20 time: 0.032663 Jun 22 09:15:50.698710 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 550/1056] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 22 09:15:50 2022] DELETE /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:15:50.704759 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:50.705380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] [instance: 04c02245-d347-4fe2-8836-ca64aeb90e74] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:50.713996 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:50.714533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:50.715339 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:50.715778 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:50.730960 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] HTTP exception thrown: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Request method failure captured: Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 HTTP/1.1 Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABistwZpJO17DX3MPEAArFqM1_jwUeRKWTmEffKF4aFNHuQ4QnFSsLvJ37SwfqQD8h24jf7IHcyDoY-T071N9F4q0tDgYG7nqSK-XhdNu8y77ermls-0I1IpsPKBo9y0AF6abtW3bCOgQ99pMvow6r2bmDkUlGZTncTF0XjZ9LwvkkbpK4 Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:15:50.732512 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/27cd77392b924e64ba52350c775cf638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_27cd77392b924e64ba52350c775cf638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/27cd77392b924e64ba52350c775cf638"}]}] Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 27cd77392b924e64ba52350c775cf638 Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1643405569 Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: 8e3e567058964720964d98e76e55e462 Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1643405569-project Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.733875 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '04c02245-d347-4fe2-8836-ca64aeb90e74'} Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:15:50.735469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. Jun 22 09:15:50.736738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:15:50.738108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] Returning 404 to user: Instance 04c02245-d347-4fe2-8836-ca64aeb90e74 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:15:50.738108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4f7209d3-696f-47b1-b637-ff15991d5e3b tempest-AttachVolumeShelveTestJSON-1643405569 tempest-AttachVolumeShelveTestJSON-1643405569-project] 10.222.0.55 "GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74" status: 404 len: 111 microversion: 2.20 time: 0.034376 Jun 22 09:15:50.738108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 507/1057] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 22 09:15:50 2022] GET /compute/v2.1/servers/04c02245-d347-4fe2-8836-ca64aeb90e74 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:15:50.994889 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-98abf40b-7fe1-478b-b55d-5d0cfe07340b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:50.995734 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-98abf40b-7fe1-478b-b55d-5d0cfe07340b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:51.017081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-98abf40b-7fe1-478b-b55d-5d0cfe07340b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:51.017952 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-98abf40b-7fe1-478b-b55d-5d0cfe07340b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:51.022989 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-98abf40b-7fe1-478b-b55d-5d0cfe07340b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:51.023428 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-98abf40b-7fe1-478b-b55d-5d0cfe07340b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:51.261432 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-98abf40b-7fe1-478b-b55d-5d0cfe07340b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:51.292882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-98abf40b-7fe1-478b-b55d-5d0cfe07340b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1314 microversion: 2.1 time: 0.288050 Jun 22 09:15:51.292882 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 551/1058] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:50 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:51.327526 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-d25f7102-7853-481d-b4cc-3661abdf6b57 req-c8788976-20fa-4f9f-ab50-edddc00f11fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "460dcf6a-df4c-4126-92fd-312fb6103b58", "tag": "8253dc87-1b31-4eac-9a5e-2977b9538036"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:51.342679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-d25f7102-7853-481d-b4cc-3661abdf6b57 req-c8788976-20fa-4f9f-ab50-edddc00f11fa service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:51.343459 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-d25f7102-7853-481d-b4cc-3661abdf6b57 req-c8788976-20fa-4f9f-ab50-edddc00f11fa service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:51.357137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-d25f7102-7853-481d-b4cc-3661abdf6b57 req-c8788976-20fa-4f9f-ab50-edddc00f11fa service nova] Creating event network-changed:8253dc87-1b31-4eac-9a5e-2977b9538036 for instance 460dcf6a-df4c-4126-92fd-312fb6103b58 on hv-cinder-80382 Jun 22 09:15:51.364513 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-d25f7102-7853-481d-b4cc-3661abdf6b57 req-c8788976-20fa-4f9f-ab50-edddc00f11fa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039908 Jun 22 09:15:51.365576 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 508/1059] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:52.299285 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-19e1f549-b963-4c4f-9c67-85a4a9a2872b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:52.299898 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-19e1f549-b963-4c4f-9c67-85a4a9a2872b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:52.306303 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-19e1f549-b963-4c4f-9c67-85a4a9a2872b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:52.306750 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-19e1f549-b963-4c4f-9c67-85a4a9a2872b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:52.307566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-19e1f549-b963-4c4f-9c67-85a4a9a2872b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:52.308000 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-19e1f549-b963-4c4f-9c67-85a4a9a2872b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:52.786931 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-19e1f549-b963-4c4f-9c67-85a4a9a2872b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:52.794318 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-19e1f549-b963-4c4f-9c67-85a4a9a2872b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1314 microversion: 2.1 time: 0.498859 Jun 22 09:15:52.795392 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 552/1060] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:52 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:53.810026 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=6 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:53.814957 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-14af78ff-a889-4a2d-8bc1-828b1785c95a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:53.815878 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-14af78ff-a889-4a2d-8bc1-828b1785c95a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:53.822555 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-14af78ff-a889-4a2d-8bc1-828b1785c95a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:53.823085 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-14af78ff-a889-4a2d-8bc1-828b1785c95a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:53.824031 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-14af78ff-a889-4a2d-8bc1-828b1785c95a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:53.824688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-14af78ff-a889-4a2d-8bc1-828b1785c95a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:53.984529 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-14af78ff-a889-4a2d-8bc1-828b1785c95a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:53.991828 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-14af78ff-a889-4a2d-8bc1-828b1785c95a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1314 microversion: 2.1 time: 0.183234 Jun 22 09:15:53.992384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 509/1061] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:53 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:55.009451 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6cb2d9c5-e42c-4f92-8935-8747d5d3ad7c tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:55.010063 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6cb2d9c5-e42c-4f92-8935-8747d5d3ad7c tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:55.012376 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=8 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:55.017913 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6cb2d9c5-e42c-4f92-8935-8747d5d3ad7c tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:55.018369 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6cb2d9c5-e42c-4f92-8935-8747d5d3ad7c tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:55.019164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6cb2d9c5-e42c-4f92-8935-8747d5d3ad7c tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:55.019612 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6cb2d9c5-e42c-4f92-8935-8747d5d3ad7c tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:55.153880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6cb2d9c5-e42c-4f92-8935-8747d5d3ad7c tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:55.162850 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6cb2d9c5-e42c-4f92-8935-8747d5d3ad7c tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1314 microversion: 2.1 time: 0.157276 Jun 22 09:15:55.163438 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 553/1062] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:55 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:56.179196 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e9dbe662-2f15-43a4-919a-c74ee9f0b8a2 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:56.179801 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e9dbe662-2f15-43a4-919a-c74ee9f0b8a2 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:56.186278 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e9dbe662-2f15-43a4-919a-c74ee9f0b8a2 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:56.187896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e9dbe662-2f15-43a4-919a-c74ee9f0b8a2 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:56.187896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e9dbe662-2f15-43a4-919a-c74ee9f0b8a2 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:56.188104 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e9dbe662-2f15-43a4-919a-c74ee9f0b8a2 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:56.329057 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e9dbe662-2f15-43a4-919a-c74ee9f0b8a2 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:56.337137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e9dbe662-2f15-43a4-919a-c74ee9f0b8a2 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1314 microversion: 2.1 time: 0.161762 Jun 22 09:15:56.337892 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 510/1063] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:56 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:57.354559 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1a119fcc-8f86-43a9-9e84-a01600c6da3a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:57.358972 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1a119fcc-8f86-43a9-9e84-a01600c6da3a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:57.364593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1a119fcc-8f86-43a9-9e84-a01600c6da3a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:57.364975 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1a119fcc-8f86-43a9-9e84-a01600c6da3a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:57.365913 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1a119fcc-8f86-43a9-9e84-a01600c6da3a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:57.366341 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1a119fcc-8f86-43a9-9e84-a01600c6da3a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:57.387720 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-c319caae-3700-4aa4-ada5-affde2251ddd req-a2fca94c-70ef-4bfa-856a-5b2375930209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "460dcf6a-df4c-4126-92fd-312fb6103b58", "name": "network-vif-plugged", "status": "completed", "tag": "8253dc87-1b31-4eac-9a5e-2977b9538036"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:57.399320 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c319caae-3700-4aa4-ada5-affde2251ddd req-a2fca94c-70ef-4bfa-856a-5b2375930209 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:57.399761 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-c319caae-3700-4aa4-ada5-affde2251ddd req-a2fca94c-70ef-4bfa-856a-5b2375930209 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:57.411600 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-c319caae-3700-4aa4-ada5-affde2251ddd req-a2fca94c-70ef-4bfa-856a-5b2375930209 service nova] Creating event network-vif-plugged:8253dc87-1b31-4eac-9a5e-2977b9538036 for instance 460dcf6a-df4c-4126-92fd-312fb6103b58 on hv-cinder-80382 Jun 22 09:15:57.416389 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-c319caae-3700-4aa4-ada5-affde2251ddd req-a2fca94c-70ef-4bfa-856a-5b2375930209 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034106 Jun 22 09:15:57.416989 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 511/1064] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:15:57.505454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1a119fcc-8f86-43a9-9e84-a01600c6da3a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:57.521522 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1a119fcc-8f86-43a9-9e84-a01600c6da3a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1314 microversion: 2.1 time: 0.170556 Jun 22 09:15:57.523864 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 554/1065] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:57 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:58.540834 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-395f8b0f-5406-40b4-b95a-291db5345319 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:58.541521 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-395f8b0f-5406-40b4-b95a-291db5345319 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:58.548249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-395f8b0f-5406-40b4-b95a-291db5345319 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:58.548691 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-395f8b0f-5406-40b4-b95a-291db5345319 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:58.549440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-395f8b0f-5406-40b4-b95a-291db5345319 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:58.549872 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-395f8b0f-5406-40b4-b95a-291db5345319 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:58.691739 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-395f8b0f-5406-40b4-b95a-291db5345319 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:58.699089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-395f8b0f-5406-40b4-b95a-291db5345319 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1314 microversion: 2.1 time: 0.163003 Jun 22 09:15:58.699651 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 512/1066] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:58 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:59.715358 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-9a054c4c-359d-43b2-bfe7-5f9a8dc3818a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:59.715965 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-9a054c4c-359d-43b2-bfe7-5f9a8dc3818a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:59.722996 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9a054c4c-359d-43b2-bfe7-5f9a8dc3818a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.723445 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9a054c4c-359d-43b2-bfe7-5f9a8dc3818a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.724203 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9a054c4c-359d-43b2-bfe7-5f9a8dc3818a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.724639 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-9a054c4c-359d-43b2-bfe7-5f9a8dc3818a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.858118 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-9a054c4c-359d-43b2-bfe7-5f9a8dc3818a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:59.866316 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-9a054c4c-359d-43b2-bfe7-5f9a8dc3818a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1463 microversion: 2.1 time: 0.154814 Jun 22 09:15:59.866892 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 555/1067] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:59 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:59.904103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b5216a16-a5ab-4f79-9f1b-efdf99ff1e35 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:59.910635 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b5216a16-a5ab-4f79-9f1b-efdf99ff1e35 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:59.911644 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b5216a16-a5ab-4f79-9f1b-efdf99ff1e35 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.912089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b5216a16-a5ab-4f79-9f1b-efdf99ff1e35 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.912839 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b5216a16-a5ab-4f79-9f1b-efdf99ff1e35 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.913264 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b5216a16-a5ab-4f79-9f1b-efdf99ff1e35 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.945038 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b5216a16-a5ab-4f79-9f1b-efdf99ff1e35 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:16:00.232409 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b5216a16-a5ab-4f79-9f1b-efdf99ff1e35 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "DELETE /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 204 len: 0 microversion: 2.1 time: 0.331816 Jun 22 09:16:00.232980 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 513/1068] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:15:59 2022] DELETE /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:16:00.241000 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2beedee4-b212-4785-9bc5-a355513d65ea tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:00.241610 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2beedee4-b212-4785-9bc5-a355513d65ea tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:00.247717 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2beedee4-b212-4785-9bc5-a355513d65ea tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:00.248168 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2beedee4-b212-4785-9bc5-a355513d65ea tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:00.248920 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2beedee4-b212-4785-9bc5-a355513d65ea tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:00.249355 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2beedee4-b212-4785-9bc5-a355513d65ea tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:00.380859 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2beedee4-b212-4785-9bc5-a355513d65ea tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:00.388265 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2beedee4-b212-4785-9bc5-a355513d65ea tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1469 microversion: 2.1 time: 0.151094 Jun 22 09:16:00.388825 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 556/1069] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:00 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:01.406554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-35d9f4e3-6acb-4d46-b1fb-2561c4b2c45a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:01.407809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-35d9f4e3-6acb-4d46-b1fb-2561c4b2c45a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:01.414942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-35d9f4e3-6acb-4d46-b1fb-2561c4b2c45a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:01.415391 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-35d9f4e3-6acb-4d46-b1fb-2561c4b2c45a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:01.416152 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-35d9f4e3-6acb-4d46-b1fb-2561c4b2c45a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:01.416587 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-35d9f4e3-6acb-4d46-b1fb-2561c4b2c45a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:01.552818 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-35d9f4e3-6acb-4d46-b1fb-2561c4b2c45a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:01.560275 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-35d9f4e3-6acb-4d46-b1fb-2561c4b2c45a tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1469 microversion: 2.1 time: 0.158009 Jun 22 09:16:01.560842 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 514/1070] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:01 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:02.577228 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-98f5ddcf-94c0-41dd-9ef2-38d2bc4f1cb7 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:02.577886 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-98f5ddcf-94c0-41dd-9ef2-38d2bc4f1cb7 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:02.584879 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-98f5ddcf-94c0-41dd-9ef2-38d2bc4f1cb7 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:02.585344 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-98f5ddcf-94c0-41dd-9ef2-38d2bc4f1cb7 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:02.586306 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-98f5ddcf-94c0-41dd-9ef2-38d2bc4f1cb7 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:02.586736 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-98f5ddcf-94c0-41dd-9ef2-38d2bc4f1cb7 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:02.720650 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-98f5ddcf-94c0-41dd-9ef2-38d2bc4f1cb7 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:02.724926 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:02.729441 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-98f5ddcf-94c0-41dd-9ef2-38d2bc4f1cb7 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1469 microversion: 2.1 time: 0.156047 Jun 22 09:16:02.730008 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 557/1071] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:02 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:03.746911 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b8c08fb6-3a35-405a-a0ea-6505b45d3d06 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:03.748133 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b8c08fb6-3a35-405a-a0ea-6505b45d3d06 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:03.755127 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b8c08fb6-3a35-405a-a0ea-6505b45d3d06 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:03.755578 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b8c08fb6-3a35-405a-a0ea-6505b45d3d06 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:03.756344 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b8c08fb6-3a35-405a-a0ea-6505b45d3d06 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:03.756780 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b8c08fb6-3a35-405a-a0ea-6505b45d3d06 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:03.775502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:03.973325 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b8c08fb6-3a35-405a-a0ea-6505b45d3d06 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:03.984127 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b8c08fb6-3a35-405a-a0ea-6505b45d3d06 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1469 microversion: 2.1 time: 0.240948 Jun 22 09:16:03.995533 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 515/1072] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:03 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:04.405647 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-fa474d1c-9ec0-41df-b2a0-a765b7e0bd0e req-51857bdd-eb00-4363-bd83-b55dcd4aba35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "460dcf6a-df4c-4126-92fd-312fb6103b58", "name": "network-vif-deleted", "tag": "8253dc87-1b31-4eac-9a5e-2977b9538036"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:04.421565 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-fa474d1c-9ec0-41df-b2a0-a765b7e0bd0e req-51857bdd-eb00-4363-bd83-b55dcd4aba35 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:04.422267 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-fa474d1c-9ec0-41df-b2a0-a765b7e0bd0e req-51857bdd-eb00-4363-bd83-b55dcd4aba35 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:04.448670 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-fa474d1c-9ec0-41df-b2a0-a765b7e0bd0e req-51857bdd-eb00-4363-bd83-b55dcd4aba35 service nova] Creating event network-vif-deleted:8253dc87-1b31-4eac-9a5e-2977b9538036 for instance 460dcf6a-df4c-4126-92fd-312fb6103b58 on hv-cinder-80382 Jun 22 09:16:04.454290 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-fa474d1c-9ec0-41df-b2a0-a765b7e0bd0e req-51857bdd-eb00-4363-bd83-b55dcd4aba35 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053221 Jun 22 09:16:04.455683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 558/1073] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:05.002580 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:05.003205 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:05.009882 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:05.010322 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:05.011192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:05.011613 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:05.044044 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:05.044489 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:05.045003 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lazy-loading 'fault' on Instance uuid 460dcf6a-df4c-4126-92fd-312fb6103b58 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:16:05.086137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01940c2ed024495d88541ca830b4d391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6349c1f0e374b0b87f64a45509f2660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:05.093456 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-71bc248e-e2c0-4a11-b9c1-9c336036cc16 tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 200 len: 1304 microversion: 2.1 time: 0.095972 Jun 22 09:16:05.094005 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 516/1074] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:04 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:06.111901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:06.112572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] [instance: 460dcf6a-df4c-4126-92fd-312fb6103b58] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:06.120309 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:06.120674 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:06.121426 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:06.121850 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:06.135475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] HTTP exception thrown: Instance 460dcf6a-df4c-4126-92fd-312fb6103b58 could not be found. Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Request method failure captured: Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 HTTP/1.1 Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABist24oYMoamHDJAA6tdxZZHDA33Un_lH9_AdnZgGlI3-KOJJcJbeiBWAfh6cfDjFjPk4I3zhYjFsYQv8Yps36VTbM13ie_ii0aiCaNWOoMVpw7lTk2CSNxlOtMKWsbeLuMlfM6rFVH0BqL9Y7GF3nMDM_InlK8dUo1e5saNSGAqeRvg8 Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: f6349c1f0e374b0b87f64a45509f2660 Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesNegativeTest-1438706581 Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:16:06.137164 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f6349c1f0e374b0b87f64a45509f2660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f6349c1f0e374b0b87f64a45509f2660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6349c1f0e374b0b87f64a45509f2660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f6349c1f0e374b0b87f64a45509f2660"}]}] Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesNegativeTest-1438706581 Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: f6349c1f0e374b0b87f64a45509f2660 Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesNegativeTest-1438706581 Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesNegativeTest-1438706581-project Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 01940c2ed024495d88541ca830b4d391 Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesNegativeTest-1438706581-project Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 460dcf6a-df4c-4126-92fd-312fb6103b58 could not be found. Jun 22 09:16:06.138529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '460dcf6a-df4c-4126-92fd-312fb6103b58'} Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 460dcf6a-df4c-4126-92fd-312fb6103b58 could not be found. Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:16:06.139512 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 460dcf6a-df4c-4126-92fd-312fb6103b58 could not be found. Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 460dcf6a-df4c-4126-92fd-312fb6103b58 could not be found. Jun 22 09:16:06.141011 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:06.142150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] Returning 404 to user: Instance 460dcf6a-df4c-4126-92fd-312fb6103b58 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:16:06.142150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3b116d8f-53cc-49de-a6e2-7b1a3fd3cf5b tempest-VolumesNegativeTest-1438706581 tempest-VolumesNegativeTest-1438706581-project] 10.222.0.55 "GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58" status: 404 len: 111 microversion: 2.1 time: 0.031826 Jun 22 09:16:06.142150 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 559/1075] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:06 2022] GET /compute/v2.1/servers/460dcf6a-df4c-4126-92fd-312fb6103b58 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:16:29.699014 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1254209810", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "networks": [{"uuid": "cbbeda80-798d-4050-82db-1ebebee57c1d"}]}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:29.704432 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:29.752151 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] validate_networks() for [('cbbeda80-798d-4050-82db-1ebebee57c1d', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:16:30.386488 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:16:30.386955 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:16:30.387431 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:16:30.387841 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:16:30.388247 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:16:30.397503 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:30.397946 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:30.398735 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:30.399201 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:30.416830 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Getting quotas for project 0a3ef9e4d3804f5e8d1cea6c7205796e. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:16:30.421409 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Getting quotas for user 61dbc07320584d8f8fcc71f7e745b5e7 and project 0a3ef9e4d3804f5e8d1cea6c7205796e. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:16:30.434355 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:16:30.436899 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:16:30.536314 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cb1fe9b1-9ca8-4ac8-b3d0-95b281046020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844087 Jun 22 09:16:30.536965 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 517/1076] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:16:30.546957 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2e880534-6b73-4d0c-9fcb-0a22d115ed96 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:30.547550 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2e880534-6b73-4d0c-9fcb-0a22d115ed96 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:30.550374 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:30.612375 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2e880534-6b73-4d0c-9fcb-0a22d115ed96 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:30.620358 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2e880534-6b73-4d0c-9fcb-0a22d115ed96 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1214 microversion: 2.1 time: 0.077355 Jun 22 09:16:30.620934 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 560/1077] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:30 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:31.637747 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-954d3f3c-2699-4695-b0ab-1970bc6dd757 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:31.638484 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-954d3f3c-2699-4695-b0ab-1970bc6dd757 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:31.645686 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-954d3f3c-2699-4695-b0ab-1970bc6dd757 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:31.646261 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-954d3f3c-2699-4695-b0ab-1970bc6dd757 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:31.647061 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-954d3f3c-2699-4695-b0ab-1970bc6dd757 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:31.647491 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-954d3f3c-2699-4695-b0ab-1970bc6dd757 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:31.715036 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-954d3f3c-2699-4695-b0ab-1970bc6dd757 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:31.723175 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-954d3f3c-2699-4695-b0ab-1970bc6dd757 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1218 microversion: 2.1 time: 0.089141 Jun 22 09:16:31.723750 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 518/1078] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:31 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:32.740602 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-bfa99121-063e-4a88-afff-8dc553f3aa68 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:32.741204 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-bfa99121-063e-4a88-afff-8dc553f3aa68 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:32.748955 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bfa99121-063e-4a88-afff-8dc553f3aa68 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:32.749394 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bfa99121-063e-4a88-afff-8dc553f3aa68 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:32.750627 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bfa99121-063e-4a88-afff-8dc553f3aa68 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:32.751149 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-bfa99121-063e-4a88-afff-8dc553f3aa68 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:32.826901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-bfa99121-063e-4a88-afff-8dc553f3aa68 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:32.834970 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-bfa99121-063e-4a88-afff-8dc553f3aa68 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1274 microversion: 2.1 time: 0.098174 Jun 22 09:16:32.835531 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 561/1079] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:32 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:33.859198 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9b3ad1d6-ab89-4712-9ce7-1d02079cb0bd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:33.861367 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9b3ad1d6-ab89-4712-9ce7-1d02079cb0bd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:33.866448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b3ad1d6-ab89-4712-9ce7-1d02079cb0bd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:33.868215 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b3ad1d6-ab89-4712-9ce7-1d02079cb0bd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:33.869126 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b3ad1d6-ab89-4712-9ce7-1d02079cb0bd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:33.869883 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9b3ad1d6-ab89-4712-9ce7-1d02079cb0bd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:34.078125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9b3ad1d6-ab89-4712-9ce7-1d02079cb0bd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:34.088302 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9b3ad1d6-ab89-4712-9ce7-1d02079cb0bd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1314 microversion: 2.1 time: 0.233027 Jun 22 09:16:34.089027 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 519/1080] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:33 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:34.684481 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-9a6f59b7-a2f4-451f-a9a8-f10e2f90cc31 req-ecc2349e-4c1d-4dd6-91c5-ff4439718ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff2f5bb-8440-429c-bc1d-b3756d9efe11", "tag": "3966bdac-5d67-4b35-be24-4657659387c1"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:34.700272 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-9a6f59b7-a2f4-451f-a9a8-f10e2f90cc31 req-ecc2349e-4c1d-4dd6-91c5-ff4439718ede service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:34.700780 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-9a6f59b7-a2f4-451f-a9a8-f10e2f90cc31 req-ecc2349e-4c1d-4dd6-91c5-ff4439718ede service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:34.712856 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-9a6f59b7-a2f4-451f-a9a8-f10e2f90cc31 req-ecc2349e-4c1d-4dd6-91c5-ff4439718ede service nova] Creating event network-changed:3966bdac-5d67-4b35-be24-4657659387c1 for instance aff2f5bb-8440-429c-bc1d-b3756d9efe11 on hv-cinder-80382 Jun 22 09:16:34.718414 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-9a6f59b7-a2f4-451f-a9a8-f10e2f90cc31 req-ecc2349e-4c1d-4dd6-91c5-ff4439718ede service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041830 Jun 22 09:16:34.719051 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 562/1081] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:35.105329 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8ef4054b-e548-4225-9a79-a0b60257945b tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:35.107073 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8ef4054b-e548-4225-9a79-a0b60257945b tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:35.113548 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ef4054b-e548-4225-9a79-a0b60257945b tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:35.114024 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ef4054b-e548-4225-9a79-a0b60257945b tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:35.114777 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ef4054b-e548-4225-9a79-a0b60257945b tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:35.115380 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8ef4054b-e548-4225-9a79-a0b60257945b tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:35.333312 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-8ef4054b-e548-4225-9a79-a0b60257945b tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:35.341205 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8ef4054b-e548-4225-9a79-a0b60257945b tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1314 microversion: 2.1 time: 0.239742 Jun 22 09:16:35.341834 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 520/1082] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:35 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:36.358637 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-0ecbc1ab-5830-4438-9ec6-e7e9f1432c3a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:36.359363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-0ecbc1ab-5830-4438-9ec6-e7e9f1432c3a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:36.368290 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0ecbc1ab-5830-4438-9ec6-e7e9f1432c3a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:36.368732 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0ecbc1ab-5830-4438-9ec6-e7e9f1432c3a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:36.369490 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0ecbc1ab-5830-4438-9ec6-e7e9f1432c3a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:36.369937 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-0ecbc1ab-5830-4438-9ec6-e7e9f1432c3a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:36.523171 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-0ecbc1ab-5830-4438-9ec6-e7e9f1432c3a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:36.531811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-0ecbc1ab-5830-4438-9ec6-e7e9f1432c3a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1314 microversion: 2.1 time: 0.177859 Jun 22 09:16:36.532637 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 563/1083] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:36 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:37.549904 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b2bdd793-301e-46f4-941c-4b0f146b6bf0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:37.550545 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b2bdd793-301e-46f4-941c-4b0f146b6bf0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:37.557019 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b2bdd793-301e-46f4-941c-4b0f146b6bf0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:37.557468 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b2bdd793-301e-46f4-941c-4b0f146b6bf0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:37.558252 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b2bdd793-301e-46f4-941c-4b0f146b6bf0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:37.558685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b2bdd793-301e-46f4-941c-4b0f146b6bf0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:37.693717 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b2bdd793-301e-46f4-941c-4b0f146b6bf0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:37.702125 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b2bdd793-301e-46f4-941c-4b0f146b6bf0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1314 microversion: 2.1 time: 0.156181 Jun 22 09:16:37.702701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 521/1084] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:37 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:38.719627 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a68e84da-3546-41aa-af3e-061753dbc0c8 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:38.720450 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a68e84da-3546-41aa-af3e-061753dbc0c8 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:38.730129 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a68e84da-3546-41aa-af3e-061753dbc0c8 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:38.740090 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a68e84da-3546-41aa-af3e-061753dbc0c8 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:38.740090 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a68e84da-3546-41aa-af3e-061753dbc0c8 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:38.740090 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a68e84da-3546-41aa-af3e-061753dbc0c8 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:38.862245 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a68e84da-3546-41aa-af3e-061753dbc0c8 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:38.869725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a68e84da-3546-41aa-af3e-061753dbc0c8 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1314 microversion: 2.1 time: 0.154647 Jun 22 09:16:38.870297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 564/1085] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:38 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:39.885376 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-61c2f7c6-bf88-4725-a212-c1a0c073a738 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:39.885973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-61c2f7c6-bf88-4725-a212-c1a0c073a738 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:39.892569 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-61c2f7c6-bf88-4725-a212-c1a0c073a738 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:39.893010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-61c2f7c6-bf88-4725-a212-c1a0c073a738 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:39.893752 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-61c2f7c6-bf88-4725-a212-c1a0c073a738 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:39.894178 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-61c2f7c6-bf88-4725-a212-c1a0c073a738 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:40.027755 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-61c2f7c6-bf88-4725-a212-c1a0c073a738 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:40.035330 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-61c2f7c6-bf88-4725-a212-c1a0c073a738 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1314 microversion: 2.1 time: 0.153776 Jun 22 09:16:40.036497 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 522/1086] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:39 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:40.917503 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-40442912-dcae-4c80-9a90-956d3f4c4164 req-aa22db00-7d5c-4211-b017-b26038bd135f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff2f5bb-8440-429c-bc1d-b3756d9efe11", "name": "network-vif-plugged", "status": "completed", "tag": "3966bdac-5d67-4b35-be24-4657659387c1"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:40.922453 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:40.927692 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-40442912-dcae-4c80-9a90-956d3f4c4164 req-aa22db00-7d5c-4211-b017-b26038bd135f service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:40.928137 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-40442912-dcae-4c80-9a90-956d3f4c4164 req-aa22db00-7d5c-4211-b017-b26038bd135f service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:40.939134 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-40442912-dcae-4c80-9a90-956d3f4c4164 req-aa22db00-7d5c-4211-b017-b26038bd135f service nova] Creating event network-vif-plugged:3966bdac-5d67-4b35-be24-4657659387c1 for instance aff2f5bb-8440-429c-bc1d-b3756d9efe11 on hv-cinder-80382 Jun 22 09:16:40.944523 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-40442912-dcae-4c80-9a90-956d3f4c4164 req-aa22db00-7d5c-4211-b017-b26038bd135f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030760 Jun 22 09:16:40.945101 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 565/1087] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:41.052616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-ee07222b-24d6-490e-8687-4e988ed52d93 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:41.053231 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-ee07222b-24d6-490e-8687-4e988ed52d93 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:41.055158 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:41.055859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=6 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:41.061145 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ee07222b-24d6-490e-8687-4e988ed52d93 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:41.061739 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ee07222b-24d6-490e-8687-4e988ed52d93 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:41.062517 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ee07222b-24d6-490e-8687-4e988ed52d93 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:41.062985 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-ee07222b-24d6-490e-8687-4e988ed52d93 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:41.188909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-ee07222b-24d6-490e-8687-4e988ed52d93 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:41.196938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-ee07222b-24d6-490e-8687-4e988ed52d93 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1314 microversion: 2.1 time: 0.148227 Jun 22 09:16:41.197500 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 523/1088] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:41 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:42.214817 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-91793084-2025-4bc5-b2e4-7350a66a69dd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:42.215531 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-91793084-2025-4bc5-b2e4-7350a66a69dd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:42.222044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-91793084-2025-4bc5-b2e4-7350a66a69dd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:42.222488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-91793084-2025-4bc5-b2e4-7350a66a69dd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:42.223916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-91793084-2025-4bc5-b2e4-7350a66a69dd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:42.224349 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-91793084-2025-4bc5-b2e4-7350a66a69dd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:42.358306 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-91793084-2025-4bc5-b2e4-7350a66a69dd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:42.366057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-91793084-2025-4bc5-b2e4-7350a66a69dd tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1314 microversion: 2.1 time: 0.155799 Jun 22 09:16:42.366758 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 566/1089] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:42 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:43.382914 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-66510cc0-2ffd-41da-883c-73f3f8c81509 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:43.383527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-66510cc0-2ffd-41da-883c-73f3f8c81509 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:43.390002 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-66510cc0-2ffd-41da-883c-73f3f8c81509 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:43.390442 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-66510cc0-2ffd-41da-883c-73f3f8c81509 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:43.391219 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-66510cc0-2ffd-41da-883c-73f3f8c81509 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:43.391650 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-66510cc0-2ffd-41da-883c-73f3f8c81509 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:43.519064 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-66510cc0-2ffd-41da-883c-73f3f8c81509 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:43.527108 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-66510cc0-2ffd-41da-883c-73f3f8c81509 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1314 microversion: 2.1 time: 0.148139 Jun 22 09:16:43.527671 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 524/1090] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:43 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:16:44.544387 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b6980c01-b6cf-4cd3-9408-2fa7c11f9e9d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:44.544990 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b6980c01-b6cf-4cd3-9408-2fa7c11f9e9d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:44.551863 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6980c01-b6cf-4cd3-9408-2fa7c11f9e9d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:44.552303 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6980c01-b6cf-4cd3-9408-2fa7c11f9e9d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:44.553051 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6980c01-b6cf-4cd3-9408-2fa7c11f9e9d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:44.553478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b6980c01-b6cf-4cd3-9408-2fa7c11f9e9d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:44.682894 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b6980c01-b6cf-4cd3-9408-2fa7c11f9e9d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:44.690653 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b6980c01-b6cf-4cd3-9408-2fa7c11f9e9d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1498 microversion: 2.1 time: 0.150188 Jun 22 09:16:44.691324 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 567/1091] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:44 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:45.592276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-044b4246-1b03-415f-a530-000e4d0c2bd0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:45.592907 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-044b4246-1b03-415f-a530-000e4d0c2bd0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:45.600284 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-044b4246-1b03-415f-a530-000e4d0c2bd0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:45.600848 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-044b4246-1b03-415f-a530-000e4d0c2bd0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:45.601604 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-044b4246-1b03-415f-a530-000e4d0c2bd0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:45.602033 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-044b4246-1b03-415f-a530-000e4d0c2bd0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:45.629200 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-044b4246-1b03-415f-a530-000e4d0c2bd0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:16:45.932568 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-044b4246-1b03-415f-a530-000e4d0c2bd0 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "DELETE /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 204 len: 0 microversion: 2.1 time: 0.343884 Jun 22 09:16:45.933164 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 525/1092] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:16:45 2022] DELETE /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:16:45.944460 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8a727b9b-3547-454c-b9d4-1a4c536a2020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:45.944460 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8a727b9b-3547-454c-b9d4-1a4c536a2020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:45.948791 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8a727b9b-3547-454c-b9d4-1a4c536a2020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:45.949234 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8a727b9b-3547-454c-b9d4-1a4c536a2020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:45.949993 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8a727b9b-3547-454c-b9d4-1a4c536a2020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:45.950426 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8a727b9b-3547-454c-b9d4-1a4c536a2020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:46.143862 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8a727b9b-3547-454c-b9d4-1a4c536a2020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:46.152107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8a727b9b-3547-454c-b9d4-1a4c536a2020 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1504 microversion: 2.1 time: 0.214526 Jun 22 09:16:46.152673 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 568/1093] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:45 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:47.169488 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-59b17217-0142-441f-b8ff-9161bec79189 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:47.170212 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-59b17217-0142-441f-b8ff-9161bec79189 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:47.176606 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59b17217-0142-441f-b8ff-9161bec79189 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:47.177631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59b17217-0142-441f-b8ff-9161bec79189 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:47.178381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59b17217-0142-441f-b8ff-9161bec79189 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:47.178814 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-59b17217-0142-441f-b8ff-9161bec79189 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:47.305421 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-59b17217-0142-441f-b8ff-9161bec79189 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:47.312878 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-59b17217-0142-441f-b8ff-9161bec79189 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1504 microversion: 2.1 time: 0.147649 Jun 22 09:16:47.313437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 526/1094] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:47 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:47.980971 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-2d0c5f1e-e072-4080-8c61-338e72fc7374 req-5c7e5dfb-75bf-4839-96f8-cd3bc70db760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff2f5bb-8440-429c-bc1d-b3756d9efe11", "name": "network-vif-deleted", "tag": "3966bdac-5d67-4b35-be24-4657659387c1"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:47.989998 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-2d0c5f1e-e072-4080-8c61-338e72fc7374 req-5c7e5dfb-75bf-4839-96f8-cd3bc70db760 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:47.990440 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-2d0c5f1e-e072-4080-8c61-338e72fc7374 req-5c7e5dfb-75bf-4839-96f8-cd3bc70db760 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:48.002210 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-2d0c5f1e-e072-4080-8c61-338e72fc7374 req-5c7e5dfb-75bf-4839-96f8-cd3bc70db760 service nova] Creating event network-vif-deleted:3966bdac-5d67-4b35-be24-4657659387c1 for instance aff2f5bb-8440-429c-bc1d-b3756d9efe11 on hv-cinder-80382 Jun 22 09:16:48.007840 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-2d0c5f1e-e072-4080-8c61-338e72fc7374 req-5c7e5dfb-75bf-4839-96f8-cd3bc70db760 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030912 Jun 22 09:16:48.011419 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 569/1095] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:48.329708 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:48.330303 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:48.336965 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:48.337704 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:48.338614 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:48.339087 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:48.371720 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:48.372171 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:48.372613 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lazy-loading 'fault' on Instance uuid aff2f5bb-8440-429c-bc1d-b3756d9efe11 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:16:48.413015 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:48.420402 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f31ac11f-7c40-423a-9cdb-542bf484a422 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 200 len: 1304 microversion: 2.1 time: 0.094705 Jun 22 09:16:48.420965 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 527/1096] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:48 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:49.441267 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:49.441966 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: aff2f5bb-8440-429c-bc1d-b3756d9efe11] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:49.448793 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:49.449247 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:49.449999 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:49.450439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:49.463476 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] HTTP exception thrown: Instance aff2f5bb-8440-429c-bc1d-b3756d9efe11 could not be found. Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Request method failure captured: Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 HTTP/1.1 Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABist3pnufvkLkhs9WlIRCpYyt1EG1NwYPIBtZKmg_tW6OHRKgMn_2osJzlu8jda3nWZECwbTFLyWlrth3OZGS16Xm__t61JCgRAnFHSEWtPzeYCFdWB9Y5_NrVbLHbeul6d13LRsURnPXw62yGebW_RMisWPekZQ3Ascsf4r1o1-KZR3U Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 0a3ef9e4d3804f5e8d1cea6c7205796e Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesActionsTest-2090013721 Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:16:49.465068 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0a3ef9e4d3804f5e8d1cea6c7205796e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0a3ef9e4d3804f5e8d1cea6c7205796e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0a3ef9e4d3804f5e8d1cea6c7205796e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0a3ef9e4d3804f5e8d1cea6c7205796e"}]}] Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesActionsTest-2090013721 Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 0a3ef9e4d3804f5e8d1cea6c7205796e Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesActionsTest-2090013721 Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesActionsTest-2090013721-project Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 61dbc07320584d8f8fcc71f7e745b5e7 Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesActionsTest-2090013721-project Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance aff2f5bb-8440-429c-bc1d-b3756d9efe11 could not be found. Jun 22 09:16:49.466963 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'aff2f5bb-8440-429c-bc1d-b3756d9efe11'} Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff2f5bb-8440-429c-bc1d-b3756d9efe11 could not be found. Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:16:49.467973 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff2f5bb-8440-429c-bc1d-b3756d9efe11 could not be found. Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff2f5bb-8440-429c-bc1d-b3756d9efe11 could not be found. Jun 22 09:16:49.469583 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:16:49.471298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Returning 404 to user: Instance aff2f5bb-8440-429c-bc1d-b3756d9efe11 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:16:49.471298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a44ee623-badc-4995-a531-9d0b7994735d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11" status: 404 len: 111 microversion: 2.1 time: 0.029970 Jun 22 09:16:49.471298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 570/1097] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:49 2022] GET /compute/v2.1/servers/aff2f5bb-8440-429c-bc1d-b3756d9efe11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:16:49.561836 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2107636557", "imageRef": "a57932f6-24ed-416a-b72b-1ba41978529a", "flavorRef": "452", "networks": [{"uuid": "cbbeda80-798d-4050-82db-1ebebee57c1d"}]}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:49.615490 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] validate_networks() for [('cbbeda80-798d-4050-82db-1ebebee57c1d', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:16:49.947694 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:16:49.948154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:16:49.948630 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:16:49.949042 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:16:49.949456 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:16:49.958162 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:49.958610 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:49.959444 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:49.959881 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:49.976599 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Getting quotas for project 0a3ef9e4d3804f5e8d1cea6c7205796e. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:16:49.980511 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Getting quotas for user 61dbc07320584d8f8fcc71f7e745b5e7 and project 0a3ef9e4d3804f5e8d1cea6c7205796e. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:16:49.992150 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:16:49.994357 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57932f6-24ed-416a-b72b-1ba41978529a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:16:50.127823 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f61e95ef-5a86-4fb6-8350-aba4e8d78b80 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569808 Jun 22 09:16:50.128785 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 528/1098] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:16:50.139624 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-e7ff1de9-5be1-424a-a817-a511fa6b2ebb tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:50.140257 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-e7ff1de9-5be1-424a-a817-a511fa6b2ebb tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:50.197183 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-e7ff1de9-5be1-424a-a817-a511fa6b2ebb tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:50.203954 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-e7ff1de9-5be1-424a-a817-a511fa6b2ebb tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1214 microversion: 2.1 time: 0.068405 Jun 22 09:16:50.204530 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 571/1099] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:50 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:51.220928 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2817b649-5a8e-45be-8a94-06df75d43c99 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:51.221508 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2817b649-5a8e-45be-8a94-06df75d43c99 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:51.228367 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2817b649-5a8e-45be-8a94-06df75d43c99 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:51.228809 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2817b649-5a8e-45be-8a94-06df75d43c99 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:51.229565 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2817b649-5a8e-45be-8a94-06df75d43c99 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:51.229994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2817b649-5a8e-45be-8a94-06df75d43c99 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:51.294358 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2817b649-5a8e-45be-8a94-06df75d43c99 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:51.302402 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2817b649-5a8e-45be-8a94-06df75d43c99 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1218 microversion: 2.1 time: 0.085405 Jun 22 09:16:51.302987 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 529/1100] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:51 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:52.319593 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-2434ae8b-5b11-48ef-8da2-69483755e330 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:52.320848 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-2434ae8b-5b11-48ef-8da2-69483755e330 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:52.328485 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2434ae8b-5b11-48ef-8da2-69483755e330 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:52.328934 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2434ae8b-5b11-48ef-8da2-69483755e330 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:52.329701 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2434ae8b-5b11-48ef-8da2-69483755e330 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:52.330138 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-2434ae8b-5b11-48ef-8da2-69483755e330 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:52.392517 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-2434ae8b-5b11-48ef-8da2-69483755e330 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:52.400891 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-2434ae8b-5b11-48ef-8da2-69483755e330 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1284 microversion: 2.1 time: 0.085699 Jun 22 09:16:52.401465 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 572/1101] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:52 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:53.420573 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1eb0f8e1-31b2-471c-a044-e1d8076f264d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:53.421205 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1eb0f8e1-31b2-471c-a044-e1d8076f264d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:53.428217 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1eb0f8e1-31b2-471c-a044-e1d8076f264d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:53.428695 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1eb0f8e1-31b2-471c-a044-e1d8076f264d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:53.429483 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1eb0f8e1-31b2-471c-a044-e1d8076f264d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:53.429912 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1eb0f8e1-31b2-471c-a044-e1d8076f264d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:53.632880 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1eb0f8e1-31b2-471c-a044-e1d8076f264d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:53.640413 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1eb0f8e1-31b2-471c-a044-e1d8076f264d tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1314 microversion: 2.1 time: 0.223652 Jun 22 09:16:53.640983 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 530/1102] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:53 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:53.881901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-93d3c6d9-cf41-4439-ba75-b29dd04cf6a9 req-c7723a3c-b34e-492e-ba0e-d6b40952194d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223", "tag": "eeeb5666-a364-4c41-9751-50a5af6277f9"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:53.890467 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-93d3c6d9-cf41-4439-ba75-b29dd04cf6a9 req-c7723a3c-b34e-492e-ba0e-d6b40952194d service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:53.890931 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-93d3c6d9-cf41-4439-ba75-b29dd04cf6a9 req-c7723a3c-b34e-492e-ba0e-d6b40952194d service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:53.902691 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-93d3c6d9-cf41-4439-ba75-b29dd04cf6a9 req-c7723a3c-b34e-492e-ba0e-d6b40952194d service nova] Creating event network-changed:eeeb5666-a364-4c41-9751-50a5af6277f9 for instance fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 on hv-cinder-80382 Jun 22 09:16:53.907304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-93d3c6d9-cf41-4439-ba75-b29dd04cf6a9 req-c7723a3c-b34e-492e-ba0e-d6b40952194d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029955 Jun 22 09:16:53.907887 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 573/1103] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:54.657839 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-dd7ef0da-b09a-4325-90a5-af3180704526 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:54.658441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-dd7ef0da-b09a-4325-90a5-af3180704526 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:54.666019 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0da-b09a-4325-90a5-af3180704526 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:54.666462 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0da-b09a-4325-90a5-af3180704526 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:54.667333 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0da-b09a-4325-90a5-af3180704526 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:54.667772 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0da-b09a-4325-90a5-af3180704526 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:54.672358 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:54.910554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-dd7ef0da-b09a-4325-90a5-af3180704526 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:54.918526 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-dd7ef0da-b09a-4325-90a5-af3180704526 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1314 microversion: 2.1 time: 0.264807 Jun 22 09:16:54.919127 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 531/1104] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:54 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:55.936173 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-21af844e-11b3-4ba3-a0da-cfcd2419f42a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:55.936867 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-21af844e-11b3-4ba3-a0da-cfcd2419f42a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:55.943518 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-21af844e-11b3-4ba3-a0da-cfcd2419f42a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:55.943964 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-21af844e-11b3-4ba3-a0da-cfcd2419f42a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:55.944720 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-21af844e-11b3-4ba3-a0da-cfcd2419f42a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:55.945153 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-21af844e-11b3-4ba3-a0da-cfcd2419f42a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:56.071118 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-21af844e-11b3-4ba3-a0da-cfcd2419f42a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:56.078533 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-21af844e-11b3-4ba3-a0da-cfcd2419f42a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1314 microversion: 2.1 time: 0.147099 Jun 22 09:16:56.079132 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 574/1105] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:55 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:57.095713 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-92b7920b-a9d5-4adb-868d-fc6a853448c9 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:57.096252 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-92b7920b-a9d5-4adb-868d-fc6a853448c9 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:57.102988 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-92b7920b-a9d5-4adb-868d-fc6a853448c9 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:57.103443 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-92b7920b-a9d5-4adb-868d-fc6a853448c9 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:57.104199 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-92b7920b-a9d5-4adb-868d-fc6a853448c9 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:57.104634 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-92b7920b-a9d5-4adb-868d-fc6a853448c9 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:57.229700 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-92b7920b-a9d5-4adb-868d-fc6a853448c9 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:57.237322 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-92b7920b-a9d5-4adb-868d-fc6a853448c9 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1314 microversion: 2.1 time: 0.145516 Jun 22 09:16:57.237878 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 532/1106] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:57 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:58.253619 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8a432aab-7abf-4a24-8bf9-4b5205969a17 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:58.254167 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8a432aab-7abf-4a24-8bf9-4b5205969a17 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:58.260615 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8a432aab-7abf-4a24-8bf9-4b5205969a17 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:58.261061 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8a432aab-7abf-4a24-8bf9-4b5205969a17 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:58.261819 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8a432aab-7abf-4a24-8bf9-4b5205969a17 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:58.262254 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8a432aab-7abf-4a24-8bf9-4b5205969a17 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:58.395046 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8a432aab-7abf-4a24-8bf9-4b5205969a17 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:58.402401 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8a432aab-7abf-4a24-8bf9-4b5205969a17 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1314 microversion: 2.1 time: 0.152790 Jun 22 09:16:58.402981 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 575/1107] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:58 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:59.418466 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4f9c2a9a-48a9-461c-b6d5-ba1a26595138 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:59.419098 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4f9c2a9a-48a9-461c-b6d5-ba1a26595138 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:59.425504 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f9c2a9a-48a9-461c-b6d5-ba1a26595138 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:59.425947 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f9c2a9a-48a9-461c-b6d5-ba1a26595138 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:59.427229 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f9c2a9a-48a9-461c-b6d5-ba1a26595138 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:59.427661 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4f9c2a9a-48a9-461c-b6d5-ba1a26595138 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:59.566894 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4f9c2a9a-48a9-461c-b6d5-ba1a26595138 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:59.566894 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4f9c2a9a-48a9-461c-b6d5-ba1a26595138 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1314 microversion: 2.1 time: 0.149659 Jun 22 09:16:59.566894 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 533/1108] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:59 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:16:59.846370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-0f1e10a4-6d37-4d74-93e3-f0542c0f5911 req-d1010e6b-291f-4be8-ab9d-7f272e9f49fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223", "name": "network-vif-plugged", "status": "completed", "tag": "eeeb5666-a364-4c41-9751-50a5af6277f9"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:59.855130 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-0f1e10a4-6d37-4d74-93e3-f0542c0f5911 req-d1010e6b-291f-4be8-ab9d-7f272e9f49fe service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:59.855563 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-0f1e10a4-6d37-4d74-93e3-f0542c0f5911 req-d1010e6b-291f-4be8-ab9d-7f272e9f49fe service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:59.867014 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-0f1e10a4-6d37-4d74-93e3-f0542c0f5911 req-d1010e6b-291f-4be8-ab9d-7f272e9f49fe service nova] Creating event network-vif-plugged:eeeb5666-a364-4c41-9751-50a5af6277f9 for instance fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 on hv-cinder-80382 Jun 22 09:16:59.871765 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-0f1e10a4-6d37-4d74-93e3-f0542c0f5911 req-d1010e6b-291f-4be8-ab9d-7f272e9f49fe service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029051 Jun 22 09:16:59.872278 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 576/1109] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:00.581597 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-07e31fc7-20fc-4425-abba-c567617e164a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:00.582204 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-07e31fc7-20fc-4425-abba-c567617e164a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:00.584688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:00.585385 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=6 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:00.586495 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:00.591163 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-07e31fc7-20fc-4425-abba-c567617e164a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:00.591606 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-07e31fc7-20fc-4425-abba-c567617e164a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:00.592377 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-07e31fc7-20fc-4425-abba-c567617e164a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:00.592807 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-07e31fc7-20fc-4425-abba-c567617e164a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:00.720732 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-07e31fc7-20fc-4425-abba-c567617e164a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:00.728783 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-07e31fc7-20fc-4425-abba-c567617e164a tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1314 microversion: 2.1 time: 0.151127 Jun 22 09:17:00.729333 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 534/1110] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:00 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:01.742920 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:01.747555 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-51a233bf-81dd-44a2-a291-539ad6f30c3e tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:01.751509 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-51a233bf-81dd-44a2-a291-539ad6f30c3e tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:01.754294 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-51a233bf-81dd-44a2-a291-539ad6f30c3e tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:01.754746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-51a233bf-81dd-44a2-a291-539ad6f30c3e tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:01.755546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-51a233bf-81dd-44a2-a291-539ad6f30c3e tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:01.755980 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-51a233bf-81dd-44a2-a291-539ad6f30c3e tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:01.758486 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=71 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:01.883327 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-51a233bf-81dd-44a2-a291-539ad6f30c3e tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:01.890592 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-51a233bf-81dd-44a2-a291-539ad6f30c3e tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1499 microversion: 2.1 time: 0.148675 Jun 22 09:17:01.891177 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 577/1111] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:01 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1499 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:02.649124 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-86eba6e6-d07d-4dee-bddf-487332647e65 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:02.649659 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-86eba6e6-d07d-4dee-bddf-487332647e65 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:02.656167 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-86eba6e6-d07d-4dee-bddf-487332647e65 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:02.656607 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-86eba6e6-d07d-4dee-bddf-487332647e65 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:02.657356 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-86eba6e6-d07d-4dee-bddf-487332647e65 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:02.657786 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-86eba6e6-d07d-4dee-bddf-487332647e65 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:02.681699 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-86eba6e6-d07d-4dee-bddf-487332647e65 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:17:02.997496 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-86eba6e6-d07d-4dee-bddf-487332647e65 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 204 len: 0 microversion: 2.1 time: 0.352961 Jun 22 09:17:02.998077 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 535/1112] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:17:02 2022] DELETE /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:17:03.006839 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3963d215-bfe8-4e07-a260-50c26fe8981c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:03.007458 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3963d215-bfe8-4e07-a260-50c26fe8981c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:03.013940 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3963d215-bfe8-4e07-a260-50c26fe8981c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:03.014385 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3963d215-bfe8-4e07-a260-50c26fe8981c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:03.015177 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3963d215-bfe8-4e07-a260-50c26fe8981c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:03.015607 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3963d215-bfe8-4e07-a260-50c26fe8981c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:03.145790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-3963d215-bfe8-4e07-a260-50c26fe8981c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:03.153242 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3963d215-bfe8-4e07-a260-50c26fe8981c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1505 microversion: 2.1 time: 0.150979 Jun 22 09:17:03.153802 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 578/1113] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:03 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:04.170989 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f823f6d2-dff6-4931-b90d-e556ee98c8af tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:04.171679 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f823f6d2-dff6-4931-b90d-e556ee98c8af tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:04.179084 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f823f6d2-dff6-4931-b90d-e556ee98c8af tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:04.179525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f823f6d2-dff6-4931-b90d-e556ee98c8af tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:04.180275 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f823f6d2-dff6-4931-b90d-e556ee98c8af tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:04.180699 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f823f6d2-dff6-4931-b90d-e556ee98c8af tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:04.310441 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f823f6d2-dff6-4931-b90d-e556ee98c8af tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:04.318005 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f823f6d2-dff6-4931-b90d-e556ee98c8af tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1505 microversion: 2.1 time: 0.151235 Jun 22 09:17:04.319123 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 536/1114] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:04 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:17:04.931738 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-3276151c-e598-4f82-9af4-c3dcabceae52 req-59544025-2590-41cc-af1c-1e1f0a8462cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223", "name": "network-vif-deleted", "tag": "eeeb5666-a364-4c41-9751-50a5af6277f9"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:04.939752 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-3276151c-e598-4f82-9af4-c3dcabceae52 req-59544025-2590-41cc-af1c-1e1f0a8462cf service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:04.945072 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-3276151c-e598-4f82-9af4-c3dcabceae52 req-59544025-2590-41cc-af1c-1e1f0a8462cf service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:04.950843 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-3276151c-e598-4f82-9af4-c3dcabceae52 req-59544025-2590-41cc-af1c-1e1f0a8462cf service nova] Creating event network-vif-deleted:eeeb5666-a364-4c41-9751-50a5af6277f9 for instance fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 on hv-cinder-80382 Jun 22 09:17:04.955620 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-3276151c-e598-4f82-9af4-c3dcabceae52 req-59544025-2590-41cc-af1c-1e1f0a8462cf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028064 Jun 22 09:17:04.956200 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 579/1115] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:05.335595 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:05.336203 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:05.342658 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:05.343132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:05.343886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:05.344319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:05.378292 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:05.378739 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:05.379348 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lazy-loading 'fault' on Instance uuid fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:17:05.422566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61dbc07320584d8f8fcc71f7e745b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:05.430267 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9a6c0ae8-7a7e-4a8f-9f82-3fbdcecbdf9c tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 200 len: 1304 microversion: 2.1 time: 0.099132 Jun 22 09:17:05.430846 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 537/1116] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:05 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:06.447873 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:06.448568 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] [instance: fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:06.450477 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=45 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:06.456208 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:06.456654 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:06.462080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:06.462080 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:06.471229 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] HTTP exception thrown: Instance fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 could not be found. Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Request method failure captured: Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 HTTP/1.1 Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABist3pnufvkLkhs9WlIRCpYyt1EG1NwYPIBtZKmg_tW6OHRKgMn_2osJzlu8jda3nWZECwbTFLyWlrth3OZGS16Xm__t61JCgRAnFHSEWtPzeYCFdWB9Y5_NrVbLHbeul6d13LRsURnPXw62yGebW_RMisWPekZQ3Ascsf4r1o1-KZR3U Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 0a3ef9e4d3804f5e8d1cea6c7205796e Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-VolumesActionsTest-2090013721 Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:17:06.472827 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0a3ef9e4d3804f5e8d1cea6c7205796e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0a3ef9e4d3804f5e8d1cea6c7205796e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0a3ef9e4d3804f5e8d1cea6c7205796e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0a3ef9e4d3804f5e8d1cea6c7205796e"}]}] Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-VolumesActionsTest-2090013721 Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 0a3ef9e4d3804f5e8d1cea6c7205796e Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-VolumesActionsTest-2090013721 Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-VolumesActionsTest-2090013721-project Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: 61dbc07320584d8f8fcc71f7e745b5e7 Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-VolumesActionsTest-2090013721-project Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 could not be found. Jun 22 09:17:06.474295 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223'} Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 could not be found. Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:17:06.475598 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 could not be found. Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 could not be found. Jun 22 09:17:06.476838 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:17:06.477956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] Returning 404 to user: Instance fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:17:06.477956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ac46abba-ae66-4988-af31-a65f09ee9922 tempest-VolumesActionsTest-2090013721 tempest-VolumesActionsTest-2090013721-project] 10.222.0.55 "GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223" status: 404 len: 111 microversion: 2.1 time: 0.031262 Jun 22 09:17:06.477956 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 580/1117] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:06 2022] GET /compute/v2.1/servers/fb19c8e7-bbf1-48e0-bfc0-1934d9f0a223 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:17:18.028448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:17:18.028823 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Wed Jun 22 09:17:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:17:45.384742 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:45.386362 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:45.563517 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1f276cfd-fd61-4d54-b754-7ebb8fc6db78 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Action: 'create', calling method: .version_select at 0x7f500e407790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-128891068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIBVjoB8c14GsBaG83Q0svQA+Gfh2SL+3qKqqsuf+FQ6agbv8IMwZAa4Xe1cpiPhlvLN0t5O3Z5fXuyPysMFTpgtvdzO3JqRVt8nDjvmIJih/3JLNY62ElvNwHCBB0bxA=="}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:45.571396 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-1f276cfd-fd61-4d54-b754-7ebb8fc6db78 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Getting quotas for project 6ebebf95a551410b97bd5651b7173f0b. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:17:45.575383 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-1f276cfd-fd61-4d54-b754-7ebb8fc6db78 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Getting quotas for user a9b4cf565a274509ad9871f4bbc52191 and project 6ebebf95a551410b97bd5651b7173f0b. Resources: {'key_pairs'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:17:45.707289 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1f276cfd-fd61-4d54-b754-7ebb8fc6db78 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.327926 Jun 22 09:17:45.708688 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 538/1118] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 22 09:17:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:18:03.605224 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1874959425", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-128891068", "security_groups": [{"name": "tempest-secgroup-smoke-682762035"}], "block_device_mapping_v2": [{"uuid": "267eee3d-e5cf-40e1-a736-bfd18f7ec536", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e2a0f500-8880-40a2-ae1d-641ca9b0e059"}]}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:18:03.616081 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=15 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:03.811058 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] validate_networks() for [('e2a0f500-8880-40a2-ae1d-641ca9b0e059', None, None, None, None, None)] {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:18:04.261585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:18:04.262044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:18:04.262517 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:18:04.262961 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:18:04.263372 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:18:04.272078 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:04.272521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:04.273309 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:04.273740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:04.290258 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Getting quotas for project 6ebebf95a551410b97bd5651b7173f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:18:04.294086 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Getting quotas for user a9b4cf565a274509ad9871f4bbc52191 and project 6ebebf95a551410b97bd5651b7173f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:18:04.349403 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:18:04.351505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='267eee3d-e5cf-40e1-a736-bfd18f7ec536',volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:18:04.772979 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4bd723c6-5734-40f6-b038-5e0069602aa0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.171868 Jun 22 09:18:04.773771 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 581/1119] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:18:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:18:04.781248 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=4 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:04.781995 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:04.786159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2f0a8d6c-e941-4534-b7ea-44b5977cd206 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:04.786918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2f0a8d6c-e941-4534-b7ea-44b5977cd206 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:04.900798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2f0a8d6c-e941-4534-b7ea-44b5977cd206 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:04.907544 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2f0a8d6c-e941-4534-b7ea-44b5977cd206 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1094 microversion: 2.1 time: 0.127773 Jun 22 09:18:04.908103 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 539/1120] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:04 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1094 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:05.930749 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-cf8cea44-46d9-4e09-a234-34c667ce6bcc tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:05.931998 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-cf8cea44-46d9-4e09-a234-34c667ce6bcc tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:05.938899 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf8cea44-46d9-4e09-a234-34c667ce6bcc tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:05.939412 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf8cea44-46d9-4e09-a234-34c667ce6bcc tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:05.940176 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf8cea44-46d9-4e09-a234-34c667ce6bcc tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:05.940616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-cf8cea44-46d9-4e09-a234-34c667ce6bcc tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:06.004868 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-cf8cea44-46d9-4e09-a234-34c667ce6bcc tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:06.012890 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-cf8cea44-46d9-4e09-a234-34c667ce6bcc tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1144 microversion: 2.1 time: 0.086510 Jun 22 09:18:06.013454 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 582/1121] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:05 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:07.030006 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-9e661c48-99f1-40c3-99d2-43c7ee02c0de tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:07.030571 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-9e661c48-99f1-40c3-99d2-43c7ee02c0de tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:07.036571 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9e661c48-99f1-40c3-99d2-43c7ee02c0de tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:07.037017 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9e661c48-99f1-40c3-99d2-43c7ee02c0de tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:07.037827 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9e661c48-99f1-40c3-99d2-43c7ee02c0de tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:07.038259 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-9e661c48-99f1-40c3-99d2-43c7ee02c0de tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:07.135647 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-9e661c48-99f1-40c3-99d2-43c7ee02c0de tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:07.143350 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-9e661c48-99f1-40c3-99d2-43c7ee02c0de tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1200 microversion: 2.1 time: 0.117621 Jun 22 09:18:07.153473 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 540/1122] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:07 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:08.161977 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-ec5d3277-d68e-4453-a889-27f413a01791 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:08.162385 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-ec5d3277-d68e-4453-a889-27f413a01791 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:08.170218 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ec5d3277-d68e-4453-a889-27f413a01791 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:08.170676 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ec5d3277-d68e-4453-a889-27f413a01791 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:08.171477 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ec5d3277-d68e-4453-a889-27f413a01791 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:08.171917 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-ec5d3277-d68e-4453-a889-27f413a01791 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:08.308483 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-ec5d3277-d68e-4453-a889-27f413a01791 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:08.316187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-ec5d3277-d68e-4453-a889-27f413a01791 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1277 microversion: 2.1 time: 0.159051 Jun 22 09:18:08.316768 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 583/1123] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:08 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:08.880224 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-dde87987-ccdd-4656-b87d-7cac252e1263 req-0a6fc709-368b-4531-9881-d4e733a95d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcb48a8-2e59-4a35-981b-f1b0db67d992", "tag": "f2cd227a-d1b0-45ad-b209-19f717b3ed2e"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:18:08.889042 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-dde87987-ccdd-4656-b87d-7cac252e1263 req-0a6fc709-368b-4531-9881-d4e733a95d6a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:08.889485 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-dde87987-ccdd-4656-b87d-7cac252e1263 req-0a6fc709-368b-4531-9881-d4e733a95d6a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:08.901577 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-dde87987-ccdd-4656-b87d-7cac252e1263 req-0a6fc709-368b-4531-9881-d4e733a95d6a service nova] Creating event network-changed:f2cd227a-d1b0-45ad-b209-19f717b3ed2e for instance efcb48a8-2e59-4a35-981b-f1b0db67d992 on hv-cinder-80382 Jun 22 09:18:08.907049 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-dde87987-ccdd-4656-b87d-7cac252e1263 req-0a6fc709-368b-4531-9881-d4e733a95d6a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092878 Jun 22 09:18:08.907204 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 541/1124] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:18:09.333193 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1b8dc5e8-f0f7-4210-8d08-95c4a3170db1 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:09.333896 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1b8dc5e8-f0f7-4210-8d08-95c4a3170db1 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:09.340357 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b8dc5e8-f0f7-4210-8d08-95c4a3170db1 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:09.340798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b8dc5e8-f0f7-4210-8d08-95c4a3170db1 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:09.341550 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b8dc5e8-f0f7-4210-8d08-95c4a3170db1 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:09.341982 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b8dc5e8-f0f7-4210-8d08-95c4a3170db1 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:09.470308 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1b8dc5e8-f0f7-4210-8d08-95c4a3170db1 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:09.478241 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1b8dc5e8-f0f7-4210-8d08-95c4a3170db1 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.148998 Jun 22 09:18:09.478799 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 584/1125] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:09 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:10.496790 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-53c57277-d73f-4b25-a9c4-51a7f64ee459 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:10.497476 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-53c57277-d73f-4b25-a9c4-51a7f64ee459 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:10.503571 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-53c57277-d73f-4b25-a9c4-51a7f64ee459 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:10.504010 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-53c57277-d73f-4b25-a9c4-51a7f64ee459 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:10.504754 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-53c57277-d73f-4b25-a9c4-51a7f64ee459 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:10.505179 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-53c57277-d73f-4b25-a9c4-51a7f64ee459 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:10.632945 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-53c57277-d73f-4b25-a9c4-51a7f64ee459 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:10.640302 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-53c57277-d73f-4b25-a9c4-51a7f64ee459 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.148128 Jun 22 09:18:10.640859 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 542/1126] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:10 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:11.656790 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-7377e955-1a88-4e63-a455-7ded1f5010f0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:11.657403 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-7377e955-1a88-4e63-a455-7ded1f5010f0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:11.664275 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7377e955-1a88-4e63-a455-7ded1f5010f0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:11.664725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7377e955-1a88-4e63-a455-7ded1f5010f0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:11.665475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7377e955-1a88-4e63-a455-7ded1f5010f0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:11.665905 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-7377e955-1a88-4e63-a455-7ded1f5010f0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:11.796910 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-7377e955-1a88-4e63-a455-7ded1f5010f0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:11.805202 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-7377e955-1a88-4e63-a455-7ded1f5010f0 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.152192 Jun 22 09:18:11.805792 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 585/1127] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:11 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:12.821943 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-c115afc1-a976-4ca2-a916-e95156e0b3b9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:12.822616 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-c115afc1-a976-4ca2-a916-e95156e0b3b9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:12.829094 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c115afc1-a976-4ca2-a916-e95156e0b3b9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:12.829544 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c115afc1-a976-4ca2-a916-e95156e0b3b9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:12.830305 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c115afc1-a976-4ca2-a916-e95156e0b3b9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:12.830771 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-c115afc1-a976-4ca2-a916-e95156e0b3b9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:12.959842 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-c115afc1-a976-4ca2-a916-e95156e0b3b9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:12.967118 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-c115afc1-a976-4ca2-a916-e95156e0b3b9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.149023 Jun 22 09:18:12.967678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 543/1128] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:12 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:13.984580 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-5f6ff3fa-18dd-4cb6-8b80-d52dea850336 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:13.985187 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-5f6ff3fa-18dd-4cb6-8b80-d52dea850336 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:13.992315 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5f6ff3fa-18dd-4cb6-8b80-d52dea850336 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:13.992767 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5f6ff3fa-18dd-4cb6-8b80-d52dea850336 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:13.993522 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5f6ff3fa-18dd-4cb6-8b80-d52dea850336 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:13.993954 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-5f6ff3fa-18dd-4cb6-8b80-d52dea850336 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:14.121169 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-5f6ff3fa-18dd-4cb6-8b80-d52dea850336 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:14.128447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-5f6ff3fa-18dd-4cb6-8b80-d52dea850336 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.148001 Jun 22 09:18:14.129014 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 586/1129] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:13 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:15.144683 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-638de291-0ac3-488b-93b2-d62c46f63c0d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:15.145294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-638de291-0ac3-488b-93b2-d62c46f63c0d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:15.148294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:15.153066 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-638de291-0ac3-488b-93b2-d62c46f63c0d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:15.153515 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-638de291-0ac3-488b-93b2-d62c46f63c0d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:15.154268 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-638de291-0ac3-488b-93b2-d62c46f63c0d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:15.154699 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-638de291-0ac3-488b-93b2-d62c46f63c0d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:15.287554 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-638de291-0ac3-488b-93b2-d62c46f63c0d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:15.293209 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-638de291-0ac3-488b-93b2-d62c46f63c0d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.152394 Jun 22 09:18:15.293778 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 544/1130] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:15 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:16.310133 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1366cd7c-e79e-483d-821c-c8fdd9bfa09d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:16.310772 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1366cd7c-e79e-483d-821c-c8fdd9bfa09d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:16.312616 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:16.313328 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=6 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:16.318628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1366cd7c-e79e-483d-821c-c8fdd9bfa09d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:16.321474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1366cd7c-e79e-483d-821c-c8fdd9bfa09d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:16.321474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1366cd7c-e79e-483d-821c-c8fdd9bfa09d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:16.321474 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1366cd7c-e79e-483d-821c-c8fdd9bfa09d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:16.452019 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1366cd7c-e79e-483d-821c-c8fdd9bfa09d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:16.460370 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1366cd7c-e79e-483d-821c-c8fdd9bfa09d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.154014 Jun 22 09:18:16.460942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 587/1131] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:16 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:17.478035 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2bb8c985-5636-4406-ac02-613bc26cd8f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:17.478635 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2bb8c985-5636-4406-ac02-613bc26cd8f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:17.485288 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2bb8c985-5636-4406-ac02-613bc26cd8f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:17.485730 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2bb8c985-5636-4406-ac02-613bc26cd8f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:17.486469 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2bb8c985-5636-4406-ac02-613bc26cd8f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:17.486918 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2bb8c985-5636-4406-ac02-613bc26cd8f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:17.612620 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-2bb8c985-5636-4406-ac02-613bc26cd8f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:17.620384 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2bb8c985-5636-4406-ac02-613bc26cd8f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.146771 Jun 22 09:18:17.628973 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 545/1132] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:17 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:18.637473 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8af99852-45eb-4a3d-95e7-096b4e8a9fa9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:18.638084 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8af99852-45eb-4a3d-95e7-096b4e8a9fa9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:18.644750 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8af99852-45eb-4a3d-95e7-096b4e8a9fa9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:18.645383 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8af99852-45eb-4a3d-95e7-096b4e8a9fa9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:18.646159 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8af99852-45eb-4a3d-95e7-096b4e8a9fa9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:18.646579 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8af99852-45eb-4a3d-95e7-096b4e8a9fa9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:18.776548 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8af99852-45eb-4a3d-95e7-096b4e8a9fa9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:18.784001 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8af99852-45eb-4a3d-95e7-096b4e8a9fa9 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.150559 Jun 22 09:18:18.784566 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 588/1133] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:18 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:19.801065 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-b0c4cacb-b4dc-4c64-9b73-1d98b3d77ec3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:19.801675 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-b0c4cacb-b4dc-4c64-9b73-1d98b3d77ec3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:19.808213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b0c4cacb-b4dc-4c64-9b73-1d98b3d77ec3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:19.808661 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b0c4cacb-b4dc-4c64-9b73-1d98b3d77ec3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:19.809418 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b0c4cacb-b4dc-4c64-9b73-1d98b3d77ec3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:19.809850 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-b0c4cacb-b4dc-4c64-9b73-1d98b3d77ec3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:19.940879 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-b0c4cacb-b4dc-4c64-9b73-1d98b3d77ec3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:19.948807 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-b0c4cacb-b4dc-4c64-9b73-1d98b3d77ec3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.151643 Jun 22 09:18:19.949370 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 546/1134] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:19 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:20.392079 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-c82090db-b5fc-47fe-b56d-5d21787223e9 req-3a6fc4f2-61a5-46e6-b596-1f86badf8667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcb48a8-2e59-4a35-981b-f1b0db67d992", "name": "network-vif-plugged", "status": "completed", "tag": "f2cd227a-d1b0-45ad-b209-19f717b3ed2e"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:18:20.400506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-c82090db-b5fc-47fe-b56d-5d21787223e9 req-3a6fc4f2-61a5-46e6-b596-1f86badf8667 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:20.400942 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-c82090db-b5fc-47fe-b56d-5d21787223e9 req-3a6fc4f2-61a5-46e6-b596-1f86badf8667 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:20.414016 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-c82090db-b5fc-47fe-b56d-5d21787223e9 req-3a6fc4f2-61a5-46e6-b596-1f86badf8667 service nova] Creating event network-vif-plugged:f2cd227a-d1b0-45ad-b209-19f717b3ed2e for instance efcb48a8-2e59-4a35-981b-f1b0db67d992 on hv-cinder-80382 Jun 22 09:18:20.419057 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-c82090db-b5fc-47fe-b56d-5d21787223e9 req-3a6fc4f2-61a5-46e6-b596-1f86badf8667 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090723 Jun 22 09:18:20.419675 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 589/1135] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:18:20.965341 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d520cc2b-a30a-4edd-ab34-e9cc1e3dc426 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:20.965950 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d520cc2b-a30a-4edd-ab34-e9cc1e3dc426 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:20.972365 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d520cc2b-a30a-4edd-ab34-e9cc1e3dc426 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:20.972811 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d520cc2b-a30a-4edd-ab34-e9cc1e3dc426 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:20.973562 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d520cc2b-a30a-4edd-ab34-e9cc1e3dc426 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:20.974000 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d520cc2b-a30a-4edd-ab34-e9cc1e3dc426 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:21.105669 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d520cc2b-a30a-4edd-ab34-e9cc1e3dc426 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:21.113363 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d520cc2b-a30a-4edd-ab34-e9cc1e3dc426 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1265 microversion: 2.1 time: 0.151899 Jun 22 09:18:21.113927 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 547/1136] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:20 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:22.130415 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1b78a52e-b961-43e4-8bff-a4467807eab8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:22.131124 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1b78a52e-b961-43e4-8bff-a4467807eab8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:22.139452 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b78a52e-b961-43e4-8bff-a4467807eab8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:22.139894 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b78a52e-b961-43e4-8bff-a4467807eab8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:22.140640 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b78a52e-b961-43e4-8bff-a4467807eab8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:22.141066 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1b78a52e-b961-43e4-8bff-a4467807eab8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:22.272862 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1b78a52e-b961-43e4-8bff-a4467807eab8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:22.280458 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1b78a52e-b961-43e4-8bff-a4467807eab8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1453 microversion: 2.1 time: 0.154312 Jun 22 09:18:22.281606 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 590/1137] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:22 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:22.300138 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d3052202-5224-4f69-ba9f-8d52bb7ee478 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:22.300740 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d3052202-5224-4f69-ba9f-8d52bb7ee478 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:22.307643 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d3052202-5224-4f69-ba9f-8d52bb7ee478 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:22.308080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d3052202-5224-4f69-ba9f-8d52bb7ee478 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:22.308822 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d3052202-5224-4f69-ba9f-8d52bb7ee478 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:22.309246 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d3052202-5224-4f69-ba9f-8d52bb7ee478 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:22.439516 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d3052202-5224-4f69-ba9f-8d52bb7ee478 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:22.447101 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d3052202-5224-4f69-ba9f-8d52bb7ee478 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1453 microversion: 2.1 time: 0.150728 Jun 22 09:18:22.452137 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 548/1138] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:22 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:24.505424 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-76740acb-87c9-40eb-8095-28056410611b req-62b1f2f5-54ea-417d-a7ee-e3d9541b1a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcb48a8-2e59-4a35-981b-f1b0db67d992", "tag": "f2cd227a-d1b0-45ad-b209-19f717b3ed2e"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:18:24.514631 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-76740acb-87c9-40eb-8095-28056410611b req-62b1f2f5-54ea-417d-a7ee-e3d9541b1a9a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:24.515088 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-76740acb-87c9-40eb-8095-28056410611b req-62b1f2f5-54ea-417d-a7ee-e3d9541b1a9a service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:24.526775 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-76740acb-87c9-40eb-8095-28056410611b req-62b1f2f5-54ea-417d-a7ee-e3d9541b1a9a service nova] Creating event network-changed:f2cd227a-d1b0-45ad-b209-19f717b3ed2e for instance efcb48a8-2e59-4a35-981b-f1b0db67d992 on hv-cinder-80382 Jun 22 09:18:24.531880 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-76740acb-87c9-40eb-8095-28056410611b req-62b1f2f5-54ea-417d-a7ee-e3d9541b1a9a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030189 Jun 22 09:18:24.532504 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 591/1139] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:19:00.098594 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:19:00.099311 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Wed Jun 22 09:19:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:20:19.711391 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR oslo.messaging._drivers.impl_rabbit [-] [641a30ee-2e80-461a-9be3-68445d9764d8] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 09:20:19.712001 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=22 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:19.712678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=50 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:19.716547 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a6d9c837-1e03-4c10-beb8-76c497858862 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:19.717029 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a6d9c837-1e03-4c10-beb8-76c497858862 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:19.722756 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a6d9c837-1e03-4c10-beb8-76c497858862 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:19.732994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a6d9c837-1e03-4c10-beb8-76c497858862 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:19.732994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a6d9c837-1e03-4c10-beb8-76c497858862 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:19.732994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a6d9c837-1e03-4c10-beb8-76c497858862 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:19.750192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a6d9c837-1e03-4c10-beb8-76c497858862 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:20:20.011300 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a6d9c837-1e03-4c10-beb8-76c497858862 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "DELETE /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 204 len: 0 microversion: 2.1 time: 0.301695 Jun 22 09:20:20.011796 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 549/1140] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:20:19 2022] DELETE /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:20:20.018571 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR oslo.messaging._drivers.impl_rabbit [-] [826f4c04-c155-4c90-ad94-d87ff1536915] AMQP server on 10.222.0.55:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 22 09:20:20.020262 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:20.020381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=54 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:20.025774 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-20f1e973-67cf-4c36-9b85-d5e4df441564 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:20.026564 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-20f1e973-67cf-4c36-9b85-d5e4df441564 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:20.033363 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-20f1e973-67cf-4c36-9b85-d5e4df441564 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:20.033811 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-20f1e973-67cf-4c36-9b85-d5e4df441564 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:20.034572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-20f1e973-67cf-4c36-9b85-d5e4df441564 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:20.035195 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-20f1e973-67cf-4c36-9b85-d5e4df441564 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:20.170756 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-20f1e973-67cf-4c36-9b85-d5e4df441564 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:20.179151 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-20f1e973-67cf-4c36-9b85-d5e4df441564 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1577 microversion: 2.1 time: 0.162758 Jun 22 09:20:20.180970 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 592/1141] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:20 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:21.197685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-68bee14d-6f39-4ee1-8914-3db1c8150c2c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:21.198378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-68bee14d-6f39-4ee1-8914-3db1c8150c2c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:21.207651 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68bee14d-6f39-4ee1-8914-3db1c8150c2c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:21.208101 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68bee14d-6f39-4ee1-8914-3db1c8150c2c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:21.209542 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68bee14d-6f39-4ee1-8914-3db1c8150c2c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:21.209974 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-68bee14d-6f39-4ee1-8914-3db1c8150c2c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:21.215351 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] [641a30ee-2e80-461a-9be3-68445d9764d8] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 34154. Jun 22 09:20:21.344378 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-68bee14d-6f39-4ee1-8914-3db1c8150c2c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:21.351948 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-68bee14d-6f39-4ee1-8914-3db1c8150c2c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1577 microversion: 2.1 time: 0.158975 Jun 22 09:20:21.352515 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 550/1142] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:21 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:22.369764 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8b0b2e89-5843-4be1-9a86-010b4e44b8d5 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:22.370382 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8b0b2e89-5843-4be1-9a86-010b4e44b8d5 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:22.380826 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8b0b2e89-5843-4be1-9a86-010b4e44b8d5 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:22.381584 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8b0b2e89-5843-4be1-9a86-010b4e44b8d5 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:22.382384 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8b0b2e89-5843-4be1-9a86-010b4e44b8d5 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:22.382844 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8b0b2e89-5843-4be1-9a86-010b4e44b8d5 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:22.388914 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO oslo.messaging._drivers.impl_rabbit [-] [826f4c04-c155-4c90-ad94-d87ff1536915] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 34164. Jun 22 09:20:22.516551 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8b0b2e89-5843-4be1-9a86-010b4e44b8d5 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:22.524614 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8b0b2e89-5843-4be1-9a86-010b4e44b8d5 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1577 microversion: 2.1 time: 0.158762 Jun 22 09:20:22.525196 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 593/1143] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:22 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:22.876994 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-3cd65368-7d1d-4ab9-b9b3-56261bae1d4e req-c4d27e2e-5271-468a-bb34-4a40dbe91776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcb48a8-2e59-4a35-981b-f1b0db67d992", "name": "network-vif-deleted", "tag": "f2cd227a-d1b0-45ad-b209-19f717b3ed2e"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:20:22.885291 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-3cd65368-7d1d-4ab9-b9b3-56261bae1d4e req-c4d27e2e-5271-468a-bb34-4a40dbe91776 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:22.885723 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-3cd65368-7d1d-4ab9-b9b3-56261bae1d4e req-c4d27e2e-5271-468a-bb34-4a40dbe91776 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:22.896575 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-3cd65368-7d1d-4ab9-b9b3-56261bae1d4e req-c4d27e2e-5271-468a-bb34-4a40dbe91776 service nova] Creating event network-vif-deleted:f2cd227a-d1b0-45ad-b209-19f717b3ed2e for instance efcb48a8-2e59-4a35-981b-f1b0db67d992 on hv-cinder-80382 Jun 22 09:20:22.901746 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-3cd65368-7d1d-4ab9-b9b3-56261bae1d4e req-c4d27e2e-5271-468a-bb34-4a40dbe91776 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028469 Jun 22 09:20:22.902428 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 551/1144] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:20:23.541778 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-3eef587f-a996-4870-9ca2-034de2589989 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:23.542548 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-3eef587f-a996-4870-9ca2-034de2589989 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:23.549430 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3eef587f-a996-4870-9ca2-034de2589989 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:23.549849 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3eef587f-a996-4870-9ca2-034de2589989 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:23.550622 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3eef587f-a996-4870-9ca2-034de2589989 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:23.551092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-3eef587f-a996-4870-9ca2-034de2589989 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:23.616753 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-3eef587f-a996-4870-9ca2-034de2589989 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:23.624907 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-3eef587f-a996-4870-9ca2-034de2589989 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 200 len: 1225 microversion: 2.1 time: 0.086996 Jun 22 09:20:23.625982 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 594/1145] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:23 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:24.642153 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:24.642780 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:24.649489 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:24.649943 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:24.650706 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:24.651172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:24.664077 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] HTTP exception thrown: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Request method failure captured: Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 HTTP/1.1 Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABist4zKhXb84WG_h7dTIiM7BoYlS-VBcTsGZzyaLrIeYVJ9OHNbbmB5_Fn0k1jNj_ErhoC-B0Z_jbpdFBlsDBaelpVeESm3GYoie6dfd7VDGjHll9LmjRMBLpihrFd-YweGIZr_6WAYA3DWOjhpwZCFXPiTUAyzNQM-QqZFIhirMjUkSY Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:20:24.665678 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}] Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: a9b4cf565a274509ad9871f4bbc52191 Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:20:24.667430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': 'efcb48a8-2e59-4a35-981b-f1b0db67d992'} Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:20:24.668381 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:20:24.669971 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:20:24.671419 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Returning 404 to user: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:20:24.671419 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-97c32996-9de1-4a8a-807c-2fd32ce38276 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 404 len: 111 microversion: 2.1 time: 0.029225 Jun 22 09:20:24.671419 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 552/1146] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:24 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:20:24.713988 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1213231226", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-128891068", "security_groups": [{"name": "tempest-secgroup-smoke-682762035"}], "block_device_mapping_v2": [{"uuid": "267eee3d-e5cf-40e1-a736-bfd18f7ec536", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e2a0f500-8880-40a2-ae1d-641ca9b0e059"}]}} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:20:24.823835 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.network.neutron [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] validate_networks() for [('e2a0f500-8880-40a2-ae1d-641ca9b0e059', None, None, None, None, None)] {{(pid=118268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:20:25.187580 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Flavor limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:20:25.188001 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Image limits 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:20:25.188470 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Flavor pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:20:25.188900 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Image pref 0:0:0 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:20:25.189310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.virt.hardware [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:20:25.197985 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:25.198428 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:25.199249 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:25.199684 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:25.215620 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Getting quotas for project 6ebebf95a551410b97bd5651b7173f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:20:25.219464 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.quota [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Getting quotas for user a9b4cf565a274509ad9871f4bbc52191 and project 6ebebf95a551410b97bd5651b7173f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=118268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:20:25.277581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Going to run 1 instances... {{(pid=118268) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:20:25.279655 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='267eee3d-e5cf-40e1-a736-bfd18f7ec536',volume_size=None,volume_type=None)] {{(pid=118268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:20:25.685453 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-da3f8add-e4e6-4979-9ec5-1f7d712be507 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.975275 Jun 22 09:20:25.686215 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 595/1147] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:20:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:20:25.696300 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-088a6933-77df-4781-8e44-431e39d327f6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:25.696909 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-088a6933-77df-4781-8e44-431e39d327f6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:25.755720 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-088a6933-77df-4781-8e44-431e39d327f6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:25.763154 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-088a6933-77df-4781-8e44-431e39d327f6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1094 microversion: 2.1 time: 0.070616 Jun 22 09:20:25.763924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 553/1148] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:25 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:26.780149 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-8241d2ce-9d9f-4c45-becc-3c4c6cad8696 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:26.780757 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-8241d2ce-9d9f-4c45-becc-3c4c6cad8696 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:26.787987 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8241d2ce-9d9f-4c45-becc-3c4c6cad8696 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:26.790447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8241d2ce-9d9f-4c45-becc-3c4c6cad8696 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:26.790447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8241d2ce-9d9f-4c45-becc-3c4c6cad8696 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:26.790447 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-8241d2ce-9d9f-4c45-becc-3c4c6cad8696 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:26.851040 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-8241d2ce-9d9f-4c45-becc-3c4c6cad8696 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:26.858637 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-8241d2ce-9d9f-4c45-becc-3c4c6cad8696 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1144 microversion: 2.1 time: 0.082354 Jun 22 09:20:26.859226 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 596/1149] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:26 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:27.875627 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-49f7f14f-8567-4a45-8cad-4c40c5b58b2e tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:27.876227 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-49f7f14f-8567-4a45-8cad-4c40c5b58b2e tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:27.884426 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-49f7f14f-8567-4a45-8cad-4c40c5b58b2e tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:27.884871 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-49f7f14f-8567-4a45-8cad-4c40c5b58b2e tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:27.885619 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-49f7f14f-8567-4a45-8cad-4c40c5b58b2e tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:27.886045 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-49f7f14f-8567-4a45-8cad-4c40c5b58b2e tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:27.966791 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-49f7f14f-8567-4a45-8cad-4c40c5b58b2e tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:27.976766 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-49f7f14f-8567-4a45-8cad-4c40c5b58b2e tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1210 microversion: 2.1 time: 0.104024 Jun 22 09:20:27.977708 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 554/1150] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:27 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:28.995456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-82dff76b-85f8-4d0c-afb9-b7bcad5330bb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:28.996749 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-82dff76b-85f8-4d0c-afb9-b7bcad5330bb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:29.003330 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-82dff76b-85f8-4d0c-afb9-b7bcad5330bb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:29.004160 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-82dff76b-85f8-4d0c-afb9-b7bcad5330bb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:29.005002 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-82dff76b-85f8-4d0c-afb9-b7bcad5330bb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:29.005938 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-82dff76b-85f8-4d0c-afb9-b7bcad5330bb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:29.170467 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-82dff76b-85f8-4d0c-afb9-b7bcad5330bb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:29.179027 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-82dff76b-85f8-4d0c-afb9-b7bcad5330bb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1277 microversion: 2.1 time: 0.187527 Jun 22 09:20:29.184411 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 597/1151] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:28 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:29.321188 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-5893a2d6-0a0b-40b1-a393-7faecf27b2cc req-c4c07654-877b-465f-afca-a7d2c755abc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251338b2-8fa8-45cd-97f9-2e5cebc53d39", "tag": "e352ec75-6932-4bcb-9abb-b505c98b5daa"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:20:29.331834 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-5893a2d6-0a0b-40b1-a393-7faecf27b2cc req-c4c07654-877b-465f-afca-a7d2c755abc7 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:29.332281 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-5893a2d6-0a0b-40b1-a393-7faecf27b2cc req-c4c07654-877b-465f-afca-a7d2c755abc7 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:29.348701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-5893a2d6-0a0b-40b1-a393-7faecf27b2cc req-c4c07654-877b-465f-afca-a7d2c755abc7 service nova] Creating event network-changed:e352ec75-6932-4bcb-9abb-b505c98b5daa for instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 on hv-cinder-80382 Jun 22 09:20:29.353941 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-5893a2d6-0a0b-40b1-a393-7faecf27b2cc req-c4c07654-877b-465f-afca-a7d2c755abc7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037977 Jun 22 09:20:29.354717 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 555/1152] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:20:30.196524 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-74231ab1-9594-4410-855d-8c9a3c591f42 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:30.197180 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-74231ab1-9594-4410-855d-8c9a3c591f42 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:30.203681 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-74231ab1-9594-4410-855d-8c9a3c591f42 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:30.204133 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-74231ab1-9594-4410-855d-8c9a3c591f42 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:30.204891 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-74231ab1-9594-4410-855d-8c9a3c591f42 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:30.205329 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-74231ab1-9594-4410-855d-8c9a3c591f42 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:30.336430 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-74231ab1-9594-4410-855d-8c9a3c591f42 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:30.343817 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-74231ab1-9594-4410-855d-8c9a3c591f42 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1265 microversion: 2.1 time: 0.151728 Jun 22 09:20:30.344381 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 598/1153] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:30 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:31.361896 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4200efd5-85d5-41b4-9362-311c942f35c4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:31.362637 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4200efd5-85d5-41b4-9362-311c942f35c4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:31.369356 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4200efd5-85d5-41b4-9362-311c942f35c4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:31.369798 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4200efd5-85d5-41b4-9362-311c942f35c4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:31.370569 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4200efd5-85d5-41b4-9362-311c942f35c4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:31.371012 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4200efd5-85d5-41b4-9362-311c942f35c4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:31.504701 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4200efd5-85d5-41b4-9362-311c942f35c4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:31.512656 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4200efd5-85d5-41b4-9362-311c942f35c4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1265 microversion: 2.1 time: 0.155608 Jun 22 09:20:31.513233 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 556/1154] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:31 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:32.529820 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-73c6cc60-2a7d-47d1-8a59-9b582991c376 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:32.530424 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-73c6cc60-2a7d-47d1-8a59-9b582991c376 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:32.537434 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-73c6cc60-2a7d-47d1-8a59-9b582991c376 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:32.537870 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-73c6cc60-2a7d-47d1-8a59-9b582991c376 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:32.538609 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-73c6cc60-2a7d-47d1-8a59-9b582991c376 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:32.539065 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-73c6cc60-2a7d-47d1-8a59-9b582991c376 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:32.666787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-73c6cc60-2a7d-47d1-8a59-9b582991c376 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:32.674226 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-73c6cc60-2a7d-47d1-8a59-9b582991c376 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1265 microversion: 2.1 time: 0.148260 Jun 22 09:20:32.674798 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 599/1155] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:32 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:33.691518 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-bec7a6fc-ac33-47a8-9649-5f777f2b86fa tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:33.692139 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-bec7a6fc-ac33-47a8-9649-5f777f2b86fa tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:33.699324 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bec7a6fc-ac33-47a8-9649-5f777f2b86fa tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:33.699774 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bec7a6fc-ac33-47a8-9649-5f777f2b86fa tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:33.700527 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bec7a6fc-ac33-47a8-9649-5f777f2b86fa tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:33.700966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-bec7a6fc-ac33-47a8-9649-5f777f2b86fa tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:33.830192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-bec7a6fc-ac33-47a8-9649-5f777f2b86fa tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:33.837711 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-bec7a6fc-ac33-47a8-9649-5f777f2b86fa tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1265 microversion: 2.1 time: 0.150117 Jun 22 09:20:33.838276 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 557/1156] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:33 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:34.854035 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-6b8febda-0aae-42e8-84a8-2b9e41179cdb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:34.854635 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-6b8febda-0aae-42e8-84a8-2b9e41179cdb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:34.861350 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6b8febda-0aae-42e8-84a8-2b9e41179cdb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:34.861789 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6b8febda-0aae-42e8-84a8-2b9e41179cdb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:34.862529 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6b8febda-0aae-42e8-84a8-2b9e41179cdb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:34.862990 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-6b8febda-0aae-42e8-84a8-2b9e41179cdb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:34.992347 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-6b8febda-0aae-42e8-84a8-2b9e41179cdb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:34.999740 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-6b8febda-0aae-42e8-84a8-2b9e41179cdb tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1265 microversion: 2.1 time: 0.149667 Jun 22 09:20:35.000298 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 600/1157] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:34 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:36.016812 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-e04b27ee-c821-48f2-822b-f56ba0581e5a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:36.017393 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-e04b27ee-c821-48f2-822b-f56ba0581e5a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:36.019779 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:36.024996 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e04b27ee-c821-48f2-822b-f56ba0581e5a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:36.025440 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e04b27ee-c821-48f2-822b-f56ba0581e5a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:36.026191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e04b27ee-c821-48f2-822b-f56ba0581e5a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:36.026624 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-e04b27ee-c821-48f2-822b-f56ba0581e5a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:36.155091 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-e04b27ee-c821-48f2-822b-f56ba0581e5a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:36.162502 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-e04b27ee-c821-48f2-822b-f56ba0581e5a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1265 microversion: 2.1 time: 0.149579 Jun 22 09:20:36.163101 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 558/1158] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:36 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:37.179234 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-93483c86-45e7-4045-9557-6b543f15119c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:37.179871 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-93483c86-45e7-4045-9557-6b543f15119c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:37.181747 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:37.182391 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=6 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:37.187666 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93483c86-45e7-4045-9557-6b543f15119c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:37.189801 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93483c86-45e7-4045-9557-6b543f15119c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:37.189801 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93483c86-45e7-4045-9557-6b543f15119c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:37.189801 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-93483c86-45e7-4045-9557-6b543f15119c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:37.319983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-93483c86-45e7-4045-9557-6b543f15119c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:37.327451 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-93483c86-45e7-4045-9557-6b543f15119c tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1265 microversion: 2.1 time: 0.152081 Jun 22 09:20:37.328037 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 601/1159] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:37 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:38.038253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:20:38.038814 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Wed Jun 22 09:20:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:20:38.344093 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-662f3b8c-44e7-436c-ba6c-5c28169d2537 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:38.344620 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-662f3b8c-44e7-436c-ba6c-5c28169d2537 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:38.351729 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-662f3b8c-44e7-436c-ba6c-5c28169d2537 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:38.352170 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-662f3b8c-44e7-436c-ba6c-5c28169d2537 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:38.352921 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-662f3b8c-44e7-436c-ba6c-5c28169d2537 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:38.353537 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-662f3b8c-44e7-436c-ba6c-5c28169d2537 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:38.484614 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-662f3b8c-44e7-436c-ba6c-5c28169d2537 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:38.492027 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-662f3b8c-44e7-436c-ba6c-5c28169d2537 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1265 microversion: 2.1 time: 0.151876 Jun 22 09:20:38.492577 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 559/1160] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:38 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:39.005519 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-87dbbe79-5800-41ec-be6e-b49cb57f3eef req-ccf0cdb0-b424-4a13-9d7a-7c55c64ee784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251338b2-8fa8-45cd-97f9-2e5cebc53d39", "name": "network-vif-plugged", "status": "completed", "tag": "e352ec75-6932-4bcb-9abb-b505c98b5daa"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:20:39.014010 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-87dbbe79-5800-41ec-be6e-b49cb57f3eef req-ccf0cdb0-b424-4a13-9d7a-7c55c64ee784 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:39.018403 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-87dbbe79-5800-41ec-be6e-b49cb57f3eef req-ccf0cdb0-b424-4a13-9d7a-7c55c64ee784 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:39.025350 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-87dbbe79-5800-41ec-be6e-b49cb57f3eef req-ccf0cdb0-b424-4a13-9d7a-7c55c64ee784 service nova] Creating event network-vif-plugged:e352ec75-6932-4bcb-9abb-b505c98b5daa for instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 on hv-cinder-80382 Jun 22 09:20:39.030506 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-87dbbe79-5800-41ec-be6e-b49cb57f3eef req-ccf0cdb0-b424-4a13-9d7a-7c55c64ee784 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029428 Jun 22 09:20:39.031128 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 602/1161] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:20:39.508013 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-cfb91a9b-c878-4081-a948-9c64e79344fd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:39.508659 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-cfb91a9b-c878-4081-a948-9c64e79344fd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:39.515067 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cfb91a9b-c878-4081-a948-9c64e79344fd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:39.515532 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cfb91a9b-c878-4081-a948-9c64e79344fd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:39.516279 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cfb91a9b-c878-4081-a948-9c64e79344fd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:39.516706 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-cfb91a9b-c878-4081-a948-9c64e79344fd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:39.646100 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-cfb91a9b-c878-4081-a948-9c64e79344fd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:39.653386 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-cfb91a9b-c878-4081-a948-9c64e79344fd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1265 microversion: 2.1 time: 0.149239 Jun 22 09:20:39.653938 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 560/1162] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:39 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:40.671214 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-85adcc65-7787-49e4-b640-b4678026e726 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:40.671912 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-85adcc65-7787-49e4-b640-b4678026e726 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:40.678727 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-85adcc65-7787-49e4-b640-b4678026e726 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:40.679197 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-85adcc65-7787-49e4-b640-b4678026e726 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:40.679952 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-85adcc65-7787-49e4-b640-b4678026e726 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:40.680391 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-85adcc65-7787-49e4-b640-b4678026e726 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:40.811521 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-85adcc65-7787-49e4-b640-b4678026e726 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:40.819154 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-85adcc65-7787-49e4-b640-b4678026e726 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1452 microversion: 2.1 time: 0.152575 Jun 22 09:20:40.819721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 603/1163] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:40 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:40.835293 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4c4e636f-5c81-4567-8d51-3f7496b438f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:20:40.836022 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4c4e636f-5c81-4567-8d51-3f7496b438f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:20:40.842693 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4c4e636f-5c81-4567-8d51-3f7496b438f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:40.846109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4c4e636f-5c81-4567-8d51-3f7496b438f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:40.846109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4c4e636f-5c81-4567-8d51-3f7496b438f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:40.846109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4c4e636f-5c81-4567-8d51-3f7496b438f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:40.976951 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4c4e636f-5c81-4567-8d51-3f7496b438f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:20:40.984584 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4c4e636f-5c81-4567-8d51-3f7496b438f8 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1452 microversion: 2.1 time: 0.153228 Jun 22 09:20:40.985156 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 561/1164] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:20:40 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:20:43.124884 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-cf24e040-4b9d-45c7-b307-33bb6630514c req-cccf0214-e708-4b58-97e4-e336c5933af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251338b2-8fa8-45cd-97f9-2e5cebc53d39", "tag": "e352ec75-6932-4bcb-9abb-b505c98b5daa"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:20:43.133230 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-cf24e040-4b9d-45c7-b307-33bb6630514c req-cccf0214-e708-4b58-97e4-e336c5933af2 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:20:43.133675 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-cf24e040-4b9d-45c7-b307-33bb6630514c req-cccf0214-e708-4b58-97e4-e336c5933af2 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:20:43.144832 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-cf24e040-4b9d-45c7-b307-33bb6630514c req-cccf0214-e708-4b58-97e4-e336c5933af2 service nova] Creating event network-changed:e352ec75-6932-4bcb-9abb-b505c98b5daa for instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 on hv-cinder-80382 Jun 22 09:20:43.149952 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-cf24e040-4b9d-45c7-b307-33bb6630514c req-cccf0214-e708-4b58-97e4-e336c5933af2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028716 Jun 22 09:20:43.150737 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 604/1165] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:22:20.107123 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:22:20.107830 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Wed Jun 22 09:22:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:22:22.595807 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:22:22.596371 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Wed Jun 22 09:22:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:22:30.324685 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:30.325479 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:30.329437 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2081806137", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-128891068", "security_groups": [{"name": "tempest-secgroup-smoke-682762035"}], "block_device_mapping_v2": [{"uuid": "7f4802f3-0ea5-47aa-ba9b-7bcfb816c1f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e2a0f500-8880-40a2-ae1d-641ca9b0e059"}]}} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:22:30.439860 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.network.neutron [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] validate_networks() for [('e2a0f500-8880-40a2-ae1d-641ca9b0e059', None, None, None, None, None)] {{(pid=118267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:22:30.882704 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Flavor limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:22:30.883165 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Image limits 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:22:30.883631 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Flavor pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:22:30.884030 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Image pref 0:0:0 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:22:30.884433 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.virt.hardware [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:22:30.893074 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:30.893510 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:30.894282 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:30.894708 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:30.912132 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Getting quotas for project 6ebebf95a551410b97bd5651b7173f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:22:30.916094 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.quota [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Getting quotas for user a9b4cf565a274509ad9871f4bbc52191 and project 6ebebf95a551410b97bd5651b7173f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=118267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:22:30.972878 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Going to run 1 instances... {{(pid=118267) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:22:30.975262 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f4802f3-0ea5-47aa-ba9b-7bcfb816c1f8',volume_size=None,volume_type=None)] {{(pid=118267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:22:31.362141 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-aa96e5d4-4fa5-4dd6-8bee-1e281d31066f tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.039212 Jun 22 09:22:31.363100 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 562/1166] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 22 09:22:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:22:31.380700 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:31.381441 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=66 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:31.385569 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-55404c5d-b360-4a9b-becd-5e832a4e9e78 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:31.386310 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-55404c5d-b360-4a9b-becd-5e832a4e9e78 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:31.445597 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-55404c5d-b360-4a9b-becd-5e832a4e9e78 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:31.457964 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-55404c5d-b360-4a9b-becd-5e832a4e9e78 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1094 microversion: 2.1 time: 0.081710 Jun 22 09:22:31.458543 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 605/1167] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:31 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:32.474462 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-826d2950-f9e8-40b7-b4f1-f09fd42742c3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:32.475089 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-826d2950-f9e8-40b7-b4f1-f09fd42742c3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:32.482340 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-826d2950-f9e8-40b7-b4f1-f09fd42742c3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:32.482792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-826d2950-f9e8-40b7-b4f1-f09fd42742c3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:32.483579 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-826d2950-f9e8-40b7-b4f1-f09fd42742c3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:32.484012 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-826d2950-f9e8-40b7-b4f1-f09fd42742c3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:32.545052 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-826d2950-f9e8-40b7-b4f1-f09fd42742c3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:32.553102 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-826d2950-f9e8-40b7-b4f1-f09fd42742c3 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1136 microversion: 2.1 time: 0.083004 Jun 22 09:22:32.553668 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 563/1168] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:32 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:33.570120 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-29056830-eb15-4d6a-a2c7-1c3fc1ec9946 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:33.570734 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-29056830-eb15-4d6a-a2c7-1c3fc1ec9946 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:33.579877 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-29056830-eb15-4d6a-a2c7-1c3fc1ec9946 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:33.586087 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-29056830-eb15-4d6a-a2c7-1c3fc1ec9946 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:33.586087 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-29056830-eb15-4d6a-a2c7-1c3fc1ec9946 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:33.586087 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-29056830-eb15-4d6a-a2c7-1c3fc1ec9946 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:33.646508 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-29056830-eb15-4d6a-a2c7-1c3fc1ec9946 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:33.653974 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-29056830-eb15-4d6a-a2c7-1c3fc1ec9946 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1210 microversion: 2.1 time: 0.088330 Jun 22 09:22:33.654536 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 606/1169] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:33 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:34.670841 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-24d00fbb-041f-4317-9255-70cd06b38966 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:34.671472 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-24d00fbb-041f-4317-9255-70cd06b38966 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:34.678914 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-24d00fbb-041f-4317-9255-70cd06b38966 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:34.679368 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-24d00fbb-041f-4317-9255-70cd06b38966 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:34.680131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-24d00fbb-041f-4317-9255-70cd06b38966 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:34.680565 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-24d00fbb-041f-4317-9255-70cd06b38966 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:34.890762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-24d00fbb-041f-4317-9255-70cd06b38966 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:34.898336 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-24d00fbb-041f-4317-9255-70cd06b38966 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1277 microversion: 2.1 time: 0.231491 Jun 22 09:22:34.898934 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 564/1170] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:34 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:35.422317 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-04cb1e1b-11a0-4f8a-8351-ea8d3c7b0f60 req-2a956275-847b-405d-a89c-af40ec5361c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fa7566-9e9a-4ed6-a784-2522df2d79c3", "tag": "0504372a-158c-4127-b9f3-ca6d4ee3d4f8"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:22:35.431247 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-04cb1e1b-11a0-4f8a-8351-ea8d3c7b0f60 req-2a956275-847b-405d-a89c-af40ec5361c5 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:35.431697 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-04cb1e1b-11a0-4f8a-8351-ea8d3c7b0f60 req-2a956275-847b-405d-a89c-af40ec5361c5 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:35.443950 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-04cb1e1b-11a0-4f8a-8351-ea8d3c7b0f60 req-2a956275-847b-405d-a89c-af40ec5361c5 service nova] Creating event network-changed:0504372a-158c-4127-b9f3-ca6d4ee3d4f8 for instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 on hv-cinder-80382 Jun 22 09:22:35.449725 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-04cb1e1b-11a0-4f8a-8351-ea8d3c7b0f60 req-2a956275-847b-405d-a89c-af40ec5361c5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030945 Jun 22 09:22:35.450415 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 607/1171] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:22:35.915080 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-1661c9f8-7889-4cc3-aeb2-5b0f9d7f366a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:35.915682 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-1661c9f8-7889-4cc3-aeb2-5b0f9d7f366a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:35.921988 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1661c9f8-7889-4cc3-aeb2-5b0f9d7f366a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:35.922430 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1661c9f8-7889-4cc3-aeb2-5b0f9d7f366a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:35.923386 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1661c9f8-7889-4cc3-aeb2-5b0f9d7f366a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:35.923820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-1661c9f8-7889-4cc3-aeb2-5b0f9d7f366a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:36.324857 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-1661c9f8-7889-4cc3-aeb2-5b0f9d7f366a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:36.332367 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-1661c9f8-7889-4cc3-aeb2-5b0f9d7f366a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.421159 Jun 22 09:22:36.333456 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 565/1172] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:35 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:37.351469 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-1d8b596e-82c1-4c78-aa39-fd25dbedc599 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:37.352159 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-1d8b596e-82c1-4c78-aa39-fd25dbedc599 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:37.358628 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1d8b596e-82c1-4c78-aa39-fd25dbedc599 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:37.359092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1d8b596e-82c1-4c78-aa39-fd25dbedc599 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:37.360227 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1d8b596e-82c1-4c78-aa39-fd25dbedc599 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:37.360227 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-1d8b596e-82c1-4c78-aa39-fd25dbedc599 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:37.485873 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-1d8b596e-82c1-4c78-aa39-fd25dbedc599 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:37.493855 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-1d8b596e-82c1-4c78-aa39-fd25dbedc599 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.147843 Jun 22 09:22:37.494406 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 608/1173] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:37 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:37.879881 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:22:37.880451 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Wed Jun 22 09:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:22:38.510908 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5043351d-3940-45fb-92b8-f4e476bb1427 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:38.511523 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5043351d-3940-45fb-92b8-f4e476bb1427 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:38.517966 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5043351d-3940-45fb-92b8-f4e476bb1427 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:38.518413 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5043351d-3940-45fb-92b8-f4e476bb1427 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:38.519193 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5043351d-3940-45fb-92b8-f4e476bb1427 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:38.519630 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5043351d-3940-45fb-92b8-f4e476bb1427 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:38.658618 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5043351d-3940-45fb-92b8-f4e476bb1427 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:38.666848 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5043351d-3940-45fb-92b8-f4e476bb1427 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.159805 Jun 22 09:22:38.667451 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 566/1174] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:38 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:39.683660 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-b1737ab5-907c-4c76-8948-e63b046694f2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:39.684265 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-b1737ab5-907c-4c76-8948-e63b046694f2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:39.690608 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b1737ab5-907c-4c76-8948-e63b046694f2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:39.691089 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b1737ab5-907c-4c76-8948-e63b046694f2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:39.692418 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b1737ab5-907c-4c76-8948-e63b046694f2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:39.692983 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-b1737ab5-907c-4c76-8948-e63b046694f2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:39.823830 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-b1737ab5-907c-4c76-8948-e63b046694f2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:39.831115 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-b1737ab5-907c-4c76-8948-e63b046694f2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.151296 Jun 22 09:22:39.831667 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 609/1175] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:39 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:40.847557 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-679faa8c-ba41-442e-ad4b-cfb57cb34b27 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:40.848749 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-679faa8c-ba41-442e-ad4b-cfb57cb34b27 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:40.855257 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-679faa8c-ba41-442e-ad4b-cfb57cb34b27 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:40.855703 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-679faa8c-ba41-442e-ad4b-cfb57cb34b27 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:40.856715 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-679faa8c-ba41-442e-ad4b-cfb57cb34b27 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:40.857148 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-679faa8c-ba41-442e-ad4b-cfb57cb34b27 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:40.902551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=2 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:40.923109 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell0:SELECT=6 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:40.987927 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-679faa8c-ba41-442e-ad4b-cfb57cb34b27 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:40.995388 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-679faa8c-ba41-442e-ad4b-cfb57cb34b27 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.151689 Jun 22 09:22:40.995947 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 567/1176] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:40 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:42.011885 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-457c0b14-256e-459f-a95a-4df143d93b00 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:42.012496 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-457c0b14-256e-459f-a95a-4df143d93b00 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:42.014954 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell0:SELECT=2 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:42.019769 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-457c0b14-256e-459f-a95a-4df143d93b00 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:42.020787 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-457c0b14-256e-459f-a95a-4df143d93b00 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:42.021546 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-457c0b14-256e-459f-a95a-4df143d93b00 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:42.021977 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-457c0b14-256e-459f-a95a-4df143d93b00 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:42.148970 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-457c0b14-256e-459f-a95a-4df143d93b00 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:42.156458 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-457c0b14-256e-459f-a95a-4df143d93b00 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.148457 Jun 22 09:22:42.157023 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 610/1177] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:42 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:43.173419 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-912ad413-a600-4673-8682-5b70ca861808 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:43.174025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-912ad413-a600-4673-8682-5b70ca861808 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:43.180681 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-912ad413-a600-4673-8682-5b70ca861808 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:43.181131 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-912ad413-a600-4673-8682-5b70ca861808 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:43.181882 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-912ad413-a600-4673-8682-5b70ca861808 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:43.182319 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-912ad413-a600-4673-8682-5b70ca861808 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:43.315972 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-912ad413-a600-4673-8682-5b70ca861808 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:43.323792 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-912ad413-a600-4673-8682-5b70ca861808 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.154613 Jun 22 09:22:43.324352 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 568/1178] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:43 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:44.341505 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d80cdd85-3689-4dcc-b384-9a4ffada0ca7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:44.342098 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d80cdd85-3689-4dcc-b384-9a4ffada0ca7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:44.349462 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d80cdd85-3689-4dcc-b384-9a4ffada0ca7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:44.349912 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d80cdd85-3689-4dcc-b384-9a4ffada0ca7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:44.350964 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d80cdd85-3689-4dcc-b384-9a4ffada0ca7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:44.351156 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d80cdd85-3689-4dcc-b384-9a4ffada0ca7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:44.497350 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-d80cdd85-3689-4dcc-b384-9a4ffada0ca7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:44.504879 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d80cdd85-3689-4dcc-b384-9a4ffada0ca7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.167251 Jun 22 09:22:44.507047 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 611/1179] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:44 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:45.587203 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4d1a985c-5791-4fb1-94d5-0aaaa067fe32 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:45.587814 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4d1a985c-5791-4fb1-94d5-0aaaa067fe32 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:45.593795 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d1a985c-5791-4fb1-94d5-0aaaa067fe32 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:45.594289 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d1a985c-5791-4fb1-94d5-0aaaa067fe32 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:45.595151 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d1a985c-5791-4fb1-94d5-0aaaa067fe32 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:45.595589 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4d1a985c-5791-4fb1-94d5-0aaaa067fe32 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:45.722940 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4d1a985c-5791-4fb1-94d5-0aaaa067fe32 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:45.730308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4d1a985c-5791-4fb1-94d5-0aaaa067fe32 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.210874 Jun 22 09:22:45.731159 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 569/1180] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:45 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:22:45.983667 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-b44796a4-d98a-4b14-85b8-c7df16d20597 req-00520af4-783e-4f40-a5b2-153205b1e9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fa7566-9e9a-4ed6-a784-2522df2d79c3", "name": "network-vif-plugged", "status": "completed", "tag": "0504372a-158c-4127-b9f3-ca6d4ee3d4f8"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:22:45.992848 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-b44796a4-d98a-4b14-85b8-c7df16d20597 req-00520af4-783e-4f40-a5b2-153205b1e9f2 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:45.993339 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-b44796a4-d98a-4b14-85b8-c7df16d20597 req-00520af4-783e-4f40-a5b2-153205b1e9f2 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:46.004070 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-b44796a4-d98a-4b14-85b8-c7df16d20597 req-00520af4-783e-4f40-a5b2-153205b1e9f2 service nova] Creating event network-vif-plugged:0504372a-158c-4127-b9f3-ca6d4ee3d4f8 for instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 on hv-cinder-80382 Jun 22 09:22:46.009658 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-b44796a4-d98a-4b14-85b8-c7df16d20597 req-00520af4-783e-4f40-a5b2-153205b1e9f2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029846 Jun 22 09:22:46.010234 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 612/1181] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:22:46.747323 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-f276758d-85e5-4259-aef7-16ca62d8f6c7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:46.747929 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-f276758d-85e5-4259-aef7-16ca62d8f6c7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:46.754314 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f276758d-85e5-4259-aef7-16ca62d8f6c7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:46.754753 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f276758d-85e5-4259-aef7-16ca62d8f6c7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:46.755536 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f276758d-85e5-4259-aef7-16ca62d8f6c7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:46.755960 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-f276758d-85e5-4259-aef7-16ca62d8f6c7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:46.886136 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-f276758d-85e5-4259-aef7-16ca62d8f6c7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:46.893480 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-f276758d-85e5-4259-aef7-16ca62d8f6c7 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1265 microversion: 2.1 time: 0.150081 Jun 22 09:22:46.894046 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 570/1182] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:46 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:47.913167 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-f747d076-1eec-4775-a3e8-31e6268a4c75 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:47.914258 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-f747d076-1eec-4775-a3e8-31e6268a4c75 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:47.920475 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f747d076-1eec-4775-a3e8-31e6268a4c75 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:47.920916 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f747d076-1eec-4775-a3e8-31e6268a4c75 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:47.921660 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f747d076-1eec-4775-a3e8-31e6268a4c75 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:47.922089 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-f747d076-1eec-4775-a3e8-31e6268a4c75 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:48.056674 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-f747d076-1eec-4775-a3e8-31e6268a4c75 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:48.064125 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-f747d076-1eec-4775-a3e8-31e6268a4c75 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1452 microversion: 2.1 time: 0.156746 Jun 22 09:22:48.064685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 613/1183] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:47 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:48.080172 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-5fac0779-a517-41c1-9fd2-bc26efeede6a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:22:48.080784 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-5fac0779-a517-41c1-9fd2-bc26efeede6a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:22:48.087820 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5fac0779-a517-41c1-9fd2-bc26efeede6a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:48.088268 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5fac0779-a517-41c1-9fd2-bc26efeede6a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:48.089025 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5fac0779-a517-41c1-9fd2-bc26efeede6a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:48.089461 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-5fac0779-a517-41c1-9fd2-bc26efeede6a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:48.216409 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-5fac0779-a517-41c1-9fd2-bc26efeede6a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:22:48.223886 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-5fac0779-a517-41c1-9fd2-bc26efeede6a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1452 microversion: 2.1 time: 0.147564 Jun 22 09:22:48.225054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 571/1184] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:22:48 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:22:50.249439 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-ce739bb9-a07b-4683-8500-8914a7b6a65a req-7f1a0715-d4b5-40cf-a3f5-81a11cacca15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fa7566-9e9a-4ed6-a784-2522df2d79c3", "tag": "0504372a-158c-4127-b9f3-ca6d4ee3d4f8"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:22:50.258625 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-ce739bb9-a07b-4683-8500-8914a7b6a65a req-7f1a0715-d4b5-40cf-a3f5-81a11cacca15 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:22:50.259097 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-ce739bb9-a07b-4683-8500-8914a7b6a65a req-7f1a0715-d4b5-40cf-a3f5-81a11cacca15 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:22:50.269995 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-ce739bb9-a07b-4683-8500-8914a7b6a65a req-7f1a0715-d4b5-40cf-a3f5-81a11cacca15 service nova] Creating event network-changed:0504372a-158c-4127-b9f3-ca6d4ee3d4f8 for instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 on hv-cinder-80382 Jun 22 09:22:50.275703 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-ce739bb9-a07b-4683-8500-8914a7b6a65a req-7f1a0715-d4b5-40cf-a3f5-81a11cacca15 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029853 Jun 22 09:22:50.276406 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 614/1185] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:23:58.046434 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:23:58.047074 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Wed Jun 22 09:23:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:24:30.239166 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:30.240308 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG dbcounter [-] [118267] Writing DB stats nova_cell1:SELECT=56 {{(pid=118267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:30.242706 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_api:SELECT=22 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:30.244089 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG dbcounter [-] [118268] Writing DB stats nova_cell1:SELECT=42 {{(pid=118268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:30.244329 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2d3dd4d1-9cf9-48b0-b732-68eb65432e37 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:30.244856 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2d3dd4d1-9cf9-48b0-b732-68eb65432e37 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:30.252525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d3dd4d1-9cf9-48b0-b732-68eb65432e37 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:30.252525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d3dd4d1-9cf9-48b0-b732-68eb65432e37 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:30.252525 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d3dd4d1-9cf9-48b0-b732-68eb65432e37 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:30.252865 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2d3dd4d1-9cf9-48b0-b732-68eb65432e37 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:30.279819 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2d3dd4d1-9cf9-48b0-b732-68eb65432e37 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Going to try to terminate instance {{(pid=118267) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:24:30.301952 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-864ca7ab-366e-456e-a543-020d22f3f189 req-c2be1cd8-ac95-4efb-9d7e-d4de15a152b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fa7566-9e9a-4ed6-a784-2522df2d79c3", "tag": "0504372a-158c-4127-b9f3-ca6d4ee3d4f8"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:24:30.310537 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-864ca7ab-366e-456e-a543-020d22f3f189 req-c2be1cd8-ac95-4efb-9d7e-d4de15a152b7 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:30.311059 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-864ca7ab-366e-456e-a543-020d22f3f189 req-c2be1cd8-ac95-4efb-9d7e-d4de15a152b7 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:30.327204 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-864ca7ab-366e-456e-a543-020d22f3f189 req-c2be1cd8-ac95-4efb-9d7e-d4de15a152b7 service nova] Creating event network-changed:0504372a-158c-4127-b9f3-ca6d4ee3d4f8 for instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 on hv-cinder-80382 Jun 22 09:24:30.328987 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-864ca7ab-366e-456e-a543-020d22f3f189 req-c2be1cd8-ac95-4efb-9d7e-d4de15a152b7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089134 Jun 22 09:24:30.329648 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 615/1186] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:24:30.543188 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2d3dd4d1-9cf9-48b0-b732-68eb65432e37 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "DELETE /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 204 len: 0 microversion: 2.1 time: 0.305560 Jun 22 09:24:30.543970 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 572/1187] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:24:30 2022] DELETE /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:24:30.552874 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4d85e05c-e595-4b29-af34-2d541a2041ca tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:30.553581 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4d85e05c-e595-4b29-af34-2d541a2041ca tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:30.559951 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4d85e05c-e595-4b29-af34-2d541a2041ca tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:30.560405 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4d85e05c-e595-4b29-af34-2d541a2041ca tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:30.561178 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4d85e05c-e595-4b29-af34-2d541a2041ca tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:30.561611 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4d85e05c-e595-4b29-af34-2d541a2041ca tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:30.749104 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-4d85e05c-e595-4b29-af34-2d541a2041ca tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:30.756921 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4d85e05c-e595-4b29-af34-2d541a2041ca tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1575 microversion: 2.1 time: 0.208571 Jun 22 09:24:30.757488 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 616/1188] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:30 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:31.775882 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-a30dcaae-3d42-4f4d-8d6a-3d73a608e3b4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:31.777202 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-a30dcaae-3d42-4f4d-8d6a-3d73a608e3b4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:31.783738 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a30dcaae-3d42-4f4d-8d6a-3d73a608e3b4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:31.784185 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a30dcaae-3d42-4f4d-8d6a-3d73a608e3b4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:31.784942 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a30dcaae-3d42-4f4d-8d6a-3d73a608e3b4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:31.785377 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-a30dcaae-3d42-4f4d-8d6a-3d73a608e3b4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:31.990231 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-a30dcaae-3d42-4f4d-8d6a-3d73a608e3b4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:31.998271 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-a30dcaae-3d42-4f4d-8d6a-3d73a608e3b4 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1575 microversion: 2.1 time: 0.226676 Jun 22 09:24:31.998901 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 573/1189] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:31 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:32.937411 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [req-02acc2d9-e889-420f-857e-d77bb8a1857a req-d3a80a39-39ad-4ad8-b1ae-99caa449d8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fa7566-9e9a-4ed6-a784-2522df2d79c3", "name": "network-vif-deleted", "tag": "0504372a-158c-4127-b9f3-ca6d4ee3d4f8"}]} {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:24:32.945751 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-02acc2d9-e889-420f-857e-d77bb8a1857a req-d3a80a39-39ad-4ad8-b1ae-99caa449d8af service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:32.947957 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [req-02acc2d9-e889-420f-857e-d77bb8a1857a req-d3a80a39-39ad-4ad8-b1ae-99caa449d8af service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:32.957384 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.compute.server_external_events [req-02acc2d9-e889-420f-857e-d77bb8a1857a req-d3a80a39-39ad-4ad8-b1ae-99caa449d8af service nova] Creating event network-vif-deleted:0504372a-158c-4127-b9f3-ca6d4ee3d4f8 for instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 on hv-cinder-80382 Jun 22 09:24:32.962414 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [req-02acc2d9-e889-420f-857e-d77bb8a1857a req-d3a80a39-39ad-4ad8-b1ae-99caa449d8af service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028704 Jun 22 09:24:32.963119 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 617/1190] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:24:33.015775 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-d21ea0a7-9e86-463c-84d6-ac4372c286be tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:33.016443 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-d21ea0a7-9e86-463c-84d6-ac4372c286be tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:33.022781 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d21ea0a7-9e86-463c-84d6-ac4372c286be tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:33.023255 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d21ea0a7-9e86-463c-84d6-ac4372c286be tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:33.024015 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d21ea0a7-9e86-463c-84d6-ac4372c286be tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:33.024448 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-d21ea0a7-9e86-463c-84d6-ac4372c286be tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:33.087661 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-d21ea0a7-9e86-463c-84d6-ac4372c286be tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:33.095203 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-d21ea0a7-9e86-463c-84d6-ac4372c286be tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1391 microversion: 2.1 time: 0.083315 Jun 22 09:24:33.095762 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 574/1191] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:33 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1391 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:34.112812 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:34.113429 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:34.119528 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:34.119968 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:34.120712 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:34.121143 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:34.151478 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:34.151915 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:34.152346 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.objects.instance [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lazy-loading 'fault' on Instance uuid 91fa7566-9e9a-4ed6-a784-2522df2d79c3 {{(pid=118268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:24:34.194642 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:34.202608 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-a5b6d59e-2151-4a55-abae-bae02d591aa6 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 200 len: 1230 microversion: 2.1 time: 0.094531 Jun 22 09:24:34.203241 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 618/1192] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:34 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:35.219630 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:35.220249 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 91fa7566-9e9a-4ed6-a784-2522df2d79c3] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:35.226617 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:35.229549 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:35.229549 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:35.229549 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:35.241638 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] HTTP exception thrown: Instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 could not be found. Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Request method failure captured: Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 HTTP/1.1 Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABist4zKhXb84WG_h7dTIiM7BoYlS-VBcTsGZzyaLrIeYVJ9OHNbbmB5_Fn0k1jNj_ErhoC-B0Z_jbpdFBlsDBaelpVeESm3GYoie6dfd7VDGjHll9LmjRMBLpihrFd-YweGIZr_6WAYA3DWOjhpwZCFXPiTUAyzNQM-QqZFIhirMjUkSY Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:24:35.243294 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}] Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: a9b4cf565a274509ad9871f4bbc52191 Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 could not be found. Jun 22 09:24:35.245514 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': '91fa7566-9e9a-4ed6-a784-2522df2d79c3'} Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 could not be found. Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:24:35.246416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 could not be found. Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 could not be found. Jun 22 09:24:35.247924 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:35.249278 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Returning 404 to user: Instance 91fa7566-9e9a-4ed6-a784-2522df2d79c3 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:24:35.249278 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-2c220c5b-5d8a-477d-b7ad-2d9f72415c07 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3" status: 404 len: 111 microversion: 2.1 time: 0.029435 Jun 22 09:24:35.249278 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 575/1193] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:35 2022] GET /compute/v2.1/servers/91fa7566-9e9a-4ed6-a784-2522df2d79c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:24:38.895685 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4f8438a1-f540-4986-ba4d-3603788ab249 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:38.896197 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4f8438a1-f540-4986-ba4d-3603788ab249 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:38.903826 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f8438a1-f540-4986-ba4d-3603788ab249 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:38.904271 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f8438a1-f540-4986-ba4d-3603788ab249 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:38.905028 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f8438a1-f540-4986-ba4d-3603788ab249 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:38.905458 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4f8438a1-f540-4986-ba4d-3603788ab249 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:38.934545 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4f8438a1-f540-4986-ba4d-3603788ab249 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Going to try to terminate instance {{(pid=118268) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:24:38.969192 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-69a5ae2c-ecc4-4865-b518-c296093dfed1 req-f24b7910-f66c-4852-9cea-ebbf032b56c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251338b2-8fa8-45cd-97f9-2e5cebc53d39", "tag": "e352ec75-6932-4bcb-9abb-b505c98b5daa"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:24:38.977774 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-69a5ae2c-ecc4-4865-b518-c296093dfed1 req-f24b7910-f66c-4852-9cea-ebbf032b56c3 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:38.978241 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-69a5ae2c-ecc4-4865-b518-c296093dfed1 req-f24b7910-f66c-4852-9cea-ebbf032b56c3 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:38.990474 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-69a5ae2c-ecc4-4865-b518-c296093dfed1 req-f24b7910-f66c-4852-9cea-ebbf032b56c3 service nova] Creating event network-changed:e352ec75-6932-4bcb-9abb-b505c98b5daa for instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 on hv-cinder-80382 Jun 22 09:24:38.996766 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-69a5ae2c-ecc4-4865-b518-c296093dfed1 req-f24b7910-f66c-4852-9cea-ebbf032b56c3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106087 Jun 22 09:24:38.997926 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 576/1194] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:24:39.293853 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4f8438a1-f540-4986-ba4d-3603788ab249 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "DELETE /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 204 len: 0 microversion: 2.1 time: 0.407116 Jun 22 09:24:39.297721 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 619/1195] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:24:38 2022] DELETE /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:24:39.303826 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4efe3e40-33b1-46c8-a418-a361fa98e731 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:39.306538 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-4efe3e40-33b1-46c8-a418-a361fa98e731 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:39.318908 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4efe3e40-33b1-46c8-a418-a361fa98e731 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:39.319672 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4efe3e40-33b1-46c8-a418-a361fa98e731 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:39.320455 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4efe3e40-33b1-46c8-a418-a361fa98e731 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:39.321054 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-4efe3e40-33b1-46c8-a418-a361fa98e731 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:39.465819 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-4efe3e40-33b1-46c8-a418-a361fa98e731 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:39.476583 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4efe3e40-33b1-46c8-a418-a361fa98e731 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1577 microversion: 2.1 time: 0.176621 Jun 22 09:24:39.476583 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 577/1196] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:39 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:40.494585 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c800f433-b060-4da4-8758-730fc5c6f39a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:40.495309 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c800f433-b060-4da4-8758-730fc5c6f39a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:40.501855 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c800f433-b060-4da4-8758-730fc5c6f39a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:40.502308 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c800f433-b060-4da4-8758-730fc5c6f39a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:40.503100 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c800f433-b060-4da4-8758-730fc5c6f39a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:40.503535 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c800f433-b060-4da4-8758-730fc5c6f39a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:40.635123 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c800f433-b060-4da4-8758-730fc5c6f39a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:40.644604 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c800f433-b060-4da4-8758-730fc5c6f39a tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1577 microversion: 2.1 time: 0.154673 Jun 22 09:24:40.652191 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 620/1197] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:40 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:41.648213 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [req-b46781d4-c017-4e0f-844f-17726c04309c req-400e52c1-aa5f-4d84-95eb-da1b27c68892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251338b2-8fa8-45cd-97f9-2e5cebc53d39", "name": "network-vif-deleted", "tag": "e352ec75-6932-4bcb-9abb-b505c98b5daa"}]} {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:24:41.653887 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-b46781d4-c017-4e0f-844f-17726c04309c req-400e52c1-aa5f-4d84-95eb-da1b27c68892 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:41.654333 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [req-b46781d4-c017-4e0f-844f-17726c04309c req-400e52c1-aa5f-4d84-95eb-da1b27c68892 service nova] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:41.661738 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-c002c6c3-cea8-4a95-a685-89b5dcaabb4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:41.662479 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-c002c6c3-cea8-4a95-a685-89b5dcaabb4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:41.667712 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.compute.server_external_events [req-b46781d4-c017-4e0f-844f-17726c04309c req-400e52c1-aa5f-4d84-95eb-da1b27c68892 service nova] Creating event network-vif-deleted:e352ec75-6932-4bcb-9abb-b505c98b5daa for instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 on hv-cinder-80382 Jun 22 09:24:41.669407 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c002c6c3-cea8-4a95-a685-89b5dcaabb4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:41.669958 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c002c6c3-cea8-4a95-a685-89b5dcaabb4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:41.670800 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c002c6c3-cea8-4a95-a685-89b5dcaabb4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:41.671464 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-c002c6c3-cea8-4a95-a685-89b5dcaabb4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:41.673622 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [req-b46781d4-c017-4e0f-844f-17726c04309c req-400e52c1-aa5f-4d84-95eb-da1b27c68892 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033548 Jun 22 09:24:41.674211 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 578/1198] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 22 09:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:24:41.735554 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.policy [None req-c002c6c3-cea8-4a95-a685-89b5dcaabb4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118268) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:41.743408 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-c002c6c3-cea8-4a95-a685-89b5dcaabb4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1391 microversion: 2.1 time: 0.085585 Jun 22 09:24:41.744009 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 621/1199] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:41 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1391 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:42.761253 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:42.768968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:42.768968 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:42.769225 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:42.770011 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:42.770551 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:42.800716 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:42.801155 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:42.801591 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.objects.instance [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lazy-loading 'fault' on Instance uuid 251338b2-8fa8-45cd-97f9-2e5cebc53d39 {{(pid=118267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:24:42.843802 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.policy [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b4cf565a274509ad9871f4bbc52191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebebf95a551410b97bd5651b7173f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118267) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:24:42.851332 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-76dcccf2-f5b1-47f6-b06c-5b4a1b2d8bdd tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 200 len: 1230 microversion: 2.1 time: 0.094896 Jun 22 09:24:42.851885 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 579/1200] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:42 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:24:43.869131 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:43.869746 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: 251338b2-8fa8-45cd-97f9-2e5cebc53d39] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:43.876773 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:43.877224 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:43.877989 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:43.878425 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:43.891572 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] HTTP exception thrown: Instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 could not be found. Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Request method failure captured: Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 HTTP/1.1 Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABist4zKhXb84WG_h7dTIiM7BoYlS-VBcTsGZzyaLrIeYVJ9OHNbbmB5_Fn0k1jNj_ErhoC-B0Z_jbpdFBlsDBaelpVeESm3GYoie6dfd7VDGjHll9LmjRMBLpihrFd-YweGIZr_6WAYA3DWOjhpwZCFXPiTUAyzNQM-QqZFIhirMjUkSY Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:24:43.893182 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}] Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: a9b4cf565a274509ad9871f4bbc52191 Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 could not be found. Jun 22 09:24:43.895044 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': '251338b2-8fa8-45cd-97f9-2e5cebc53d39'} Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 could not be found. Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:24:43.896107 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 could not be found. Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 could not be found. Jun 22 09:24:43.897851 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:43.899395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Returning 404 to user: Instance 251338b2-8fa8-45cd-97f9-2e5cebc53d39 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:24:43.899395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-4e3808f7-b51b-48a5-9a12-27e0bc484b4d tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39" status: 404 len: 111 microversion: 2.1 time: 0.029393 Jun 22 09:24:43.899395 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 622/1201] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:43 2022] GET /compute/v2.1/servers/251338b2-8fa8-45cd-97f9-2e5cebc53d39 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:24:44.445778 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:44.446266 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.compute.api [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118267) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:44.453288 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:44.453737 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:44.454503 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:44.454982 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG oslo_concurrency.lockutils [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:44.468620 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.wsgi [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] HTTP exception thrown: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Request method failure captured: Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: request: DELETE /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 HTTP/1.1 Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept: application/json Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Accept-Encoding: identity Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Connection: close Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Length: 0 Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Content-Type: application/json Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Host: 10.222.0.55 Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Openstack-System-Scope: None Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: User-Agent: python-urllib3/1.26.9 Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Auth-Token: gAAAAABist4zKhXb84WG_h7dTIiM7BoYlS-VBcTsGZzyaLrIeYVJ9OHNbbmB5_Fn0k1jNj_ErhoC-B0Z_jbpdFBlsDBaelpVeESm3GYoie6dfd7VDGjHll9LmjRMBLpihrFd-YweGIZr_6WAYA3DWOjhpwZCFXPiTUAyzNQM-QqZFIhirMjUkSY Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Id: None Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Domain-Name: None Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Identity-Status: Confirmed Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Is-Admin-Project: True Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Id: default Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Domain-Name: Default Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Project-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Role: member,reader Jun 22 09:24:44.486696 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Roles: member,reader Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}] Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-Tenant-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Id: default Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Domain-Name: Default Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Id: a9b4cf565a274509ad9871f4bbc52191 Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: X-User-Name: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: method: > Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: exception: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.488482 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: action_args: {'id': 'efcb48a8-2e59-4a35-981b-f1b0db67d992'} Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:24:44.489566 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.491191 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.492861 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Returning 404 to user: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. {{(pid=118267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:24:44.492861 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-8c1cfe3e-1919-429f-9d24-c0c5e00acd31 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "DELETE /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 404 len: 111 microversion: 2.1 time: 0.029720 Jun 22 09:24:44.492861 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 580/1202] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 22 09:24:44 2022] DELETE /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:24:44.493994 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '>' {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:44.494712 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.compute.api [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] [instance: efcb48a8-2e59-4a35-981b-f1b0db67d992] Fetching instance by UUID {{(pid=118268) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:24:44.501102 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:44.501541 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:44.502456 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:24:44.502918 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG oslo_concurrency.lockutils [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Lock "bfb77ed2-4ccd-4224-9035-066f22604e48" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:24:44.516815 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.wsgi [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] HTTP exception thrown: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Request method failure captured: Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: request: GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 HTTP/1.1 Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept: application/json Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Accept-Encoding: identity Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Connection: close Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Length: 0 Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Content-Type: application/json Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Host: 10.222.0.55 Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Openstack-System-Scope: None Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: User-Agent: python-urllib3/1.26.9 Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Auth-Token: gAAAAABist4zKhXb84WG_h7dTIiM7BoYlS-VBcTsGZzyaLrIeYVJ9OHNbbmB5_Fn0k1jNj_ErhoC-B0Z_jbpdFBlsDBaelpVeESm3GYoie6dfd7VDGjHll9LmjRMBLpihrFd-YweGIZr_6WAYA3DWOjhpwZCFXPiTUAyzNQM-QqZFIhirMjUkSY Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Id: None Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Domain-Name: None Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Identity-Status: Confirmed Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Is-Admin-Project: True Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Id: default Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Domain-Name: Default Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Project-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Role: member,reader Jun 22 09:24:44.518304 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Roles: member,reader Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6ebebf95a551410b97bd5651b7173f0b"}]}] Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Id: 6ebebf95a551410b97bd5651b7173f0b Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-Tenant-Name: tempest-TestVolumeBootPattern-1694002605 Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Id: default Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Domain-Name: Default Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Id: a9b4cf565a274509ad9871f4bbc52191 Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: X-User-Name: tempest-TestVolumeBootPattern-1694002605-project Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: method: > Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: exception: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.520092 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: action_args: {'id': 'efcb48a8-2e59-4a35-981b-f1b0db67d992'} Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: {{(pid=118268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:24:44.521076 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. Jun 22 09:24:44.522683 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: ERROR nova.api.openstack.wsgi Jun 22 09:24:44.524297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: DEBUG nova.api.openstack.wsgi [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Returning 404 to user: Instance efcb48a8-2e59-4a35-981b-f1b0db67d992 could not be found. {{(pid=118268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:24:44.524297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO nova.api.openstack.requestlog [None req-d74b4809-7284-4502-80ff-387785c590c2 tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992" status: 404 len: 111 microversion: 2.1 time: 0.030308 Jun 22 09:24:44.524297 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: [pid: 118268|app: 0|req: 623/1203] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 22 09:24:44 2022] GET /compute/v2.1/servers/efcb48a8-2e59-4a35-981b-f1b0db67d992 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:24:46.086547 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: DEBUG nova.api.openstack.wsgi [None req-4c98697e-ff8d-4e1c-9d17-870eacb85f5b tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] Calling method '.version_select at 0x7f50101ef280>' {{(pid=118267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:24:46.174474 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO nova.api.openstack.requestlog [None req-4c98697e-ff8d-4e1c-9d17-870eacb85f5b tempest-TestVolumeBootPattern-1694002605 tempest-TestVolumeBootPattern-1694002605-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-128891068" status: 202 len: 0 microversion: 2.1 time: 0.092238 Jun 22 09:24:46.175106 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: [pid: 118267|app: 0|req: 581/1204] 10.222.0.55 () {58 vars in 1259 bytes} [Wed Jun 22 09:24:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-128891068 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:25:40.114901 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:25:40.115498 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Wed Jun 22 09:25:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:25:42.603926 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:25:42.604549 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Wed Jun 22 09:25:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:25:45.661172 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:25:45.661720 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Wed Jun 22 09:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:27:18.054902 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:27:18.055412 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Wed Jun 22 09:27:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:27:37.889834 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:27:37.890416 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Wed Jun 22 09:27:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:27:40.093113 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:27:40.093686 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Wed Jun 22 09:27:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:29:00.123412 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:29:00.124167 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Wed Jun 22 09:29:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:29:02.612852 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:29:02.613388 dv-cinder-803823-12-iscsi devstack@n-api.service[118267]: Wed Jun 22 09:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:29:05.670249 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:29:05.671045 dv-cinder-803823-12-iscsi devstack@n-api.service[118268]: Wed Jun 22 09:29:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!